-- Logs begin at Fri 2022-01-28 19:46:52 UTC, end at Fri 2022-01-28 20:47:43 UTC. -- Jan 28 20:17:42.049276 dv-cinder-826350-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 20:17:42.058219 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 20:17:42 2022] *** Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: nodename: dv-cinder-826350-4-iscsi Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: machine: x86_64 Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: clock source: unix Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: pcre jit disabled Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: detected number of CPU cores: 4 Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: current working directory: / Jan 28 20:17:42.060264 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: detected binary path: /usr/bin/uwsgi-core Jan 28 20:17:42.061528 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: your processes number limit is 47680 Jan 28 20:17:42.061528 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: your memory page size is 4096 bytes Jan 28 20:17:42.061528 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: detected max file descriptor number: 2048 Jan 28 20:17:42.061528 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: lock engine: pthread robust mutexes Jan 28 20:17:42.061528 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: thunder lock: enabled Jan 28 20:17:42.061528 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 20:17:42.061528 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 20:17:42.105953 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: Python main interpreter initialized at 0x55b662bd99c0 Jan 28 20:17:42.105953 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: python threads support enabled Jan 28 20:17:42.105953 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: your server socket listen backlog is limited to 100 connections Jan 28 20:17:42.105953 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: your mercy for graceful operations on workers is 90 seconds Jan 28 20:17:42.106313 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 20:17:42.106405 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: *** Operational MODE: preforking *** Jan 28 20:17:42.106621 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: *** uWSGI is running in multiple interpreter mode *** Jan 28 20:17:42.106621 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: spawned uWSGI master process (pid: 101638) Jan 28 20:17:42.106814 dv-cinder-826350-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 20:17:42.107500 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: spawned uWSGI worker 1 (pid: 101639, cores: 1) Jan 28 20:17:42.107720 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: spawned uWSGI worker 2 (pid: 101640, cores: 1) Jan 28 20:17:42.107879 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 20:17:43.923701 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 20:17:43.923701 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: from cryptography.utils import int_from_bytes Jan 28 20:17:43.924381 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 20:17:43.924381 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: from cryptography.utils import int_from_bytes Jan 28 20:17:43.946410 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 20:17:43.946410 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: from cryptography.utils import int_from_bytes Jan 28 20:17:43.946949 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 20:17:43.946949 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: from cryptography.utils import int_from_bytes Jan 28 20:17:46.519309 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 20:17:46.519850 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 20:17:46.519938 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 20:17:46.520308 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 20:17:46.520387 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 20:17:46.520461 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 20:17:46.520527 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 20:17:46.520653 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 20:17:46.520866 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 20:17:46.521000 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.521166 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 20:17:46.521326 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.521603 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.521697 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.521954 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.522060 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.522277 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.522363 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.522594 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.522686 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.522912 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.523005 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.523221 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.523310 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.523540 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.523633 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.523796 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.523880 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.524111 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.524196 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.524416 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.524511 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-4-iscsi {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.524729 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.524813 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.525033 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.525116 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-4-iscsi {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.525345 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.525454 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.525655 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.525744 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.525976 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.526062 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.526296 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.526381 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.526598 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.526681 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.526920 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.527099 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.528307 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.528402 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.528535 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.528663 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.528794 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.528928 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.529075 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.529189 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.529311 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.529434 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.529563 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.529696 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.529819 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.529994 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.530119 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.530245 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.530382 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.530507 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.530636 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.530759 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.530891 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.531015 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-4-iscsi {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.531147 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.531270 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.531394 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-4-iscsi {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.531527 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.531650 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.531772 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.531884 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.532068 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.532205 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.532380 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.532507 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.532728 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.532864 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.532997 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.533129 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.533302 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.533430 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.533610 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.533749 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.533959 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.534100 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.534282 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.534411 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.534600 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.534729 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.534919 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.535058 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.535221 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.535349 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.535523 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.535650 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.535830 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.535954 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.536135 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.536260 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.536692 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.536834 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.536995 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.537149 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.537282 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.537415 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.537540 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.537670 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.537823 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.538000 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.538171 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.538317 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.538491 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.538621 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.538745 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.538877 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.539013 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.539139 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.539263 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.539385 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.539583 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.539711 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.539889 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.540023 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.540198 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.540333 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.540504 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.540644 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.540809 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.540983 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.541110 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.541239 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.541405 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.541543 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.541707 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.541834 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.542034 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.542160 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.542341 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.542482 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.542653 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.542787 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.542965 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.543092 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.543271 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.543408 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.543582 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.543709 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.543901 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.544031 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.544212 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.544348 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.544524 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.544651 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.544876 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.545008 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.545191 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.545319 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.545502 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.545643 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.545814 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.545981 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.546156 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.546284 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.546467 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.546601 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.546773 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.546921 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.547080 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.547234 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.547371 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.547556 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.547694 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.547895 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.548032 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.548200 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.548328 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.548458 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.548583 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.548740 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.548869 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.549047 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.549183 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.549366 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.549493 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.549674 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.549810 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.550004 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.550133 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.550312 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.550441 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.550612 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.550749 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.550919 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.551050 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.551258 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.551387 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.551520 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.551646 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.551812 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.551948 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.552117 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.552257 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.552420 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.552546 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.552724 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.552850 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.553025 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.553161 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.553330 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.553470 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.553646 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.553774 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.553987 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.554128 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.554297 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.554426 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.554602 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.554737 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.554906 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.555048 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.555211 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.555347 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.555531 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.555660 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.555837 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.555973 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.556141 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.556269 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.556461 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.556596 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.556767 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.556903 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.557070 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.557198 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.557384 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.557512 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.557689 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.557824 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.558035 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.558159 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.558322 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.558462 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.558623 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.558827 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.558960 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.559083 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.559229 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.559356 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.559535 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.559663 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.559838 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.559964 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.560140 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.560268 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.560955 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.561083 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.561259 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.561386 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.561563 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.561697 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.561863 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.562034 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.562191 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.562325 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.562495 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.562623 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.562810 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.562937 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.563127 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.563253 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.563435 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.563570 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.563739 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.563872 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.564043 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.564178 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.564362 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.564497 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:17:46.564691 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.564817 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.565020 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.565146 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.565358 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.565492 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.565671 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.565815 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.566022 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.566152 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.566353 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.566481 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.566669 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.566796 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.566978 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.567112 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.567292 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.567419 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.567614 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.567741 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.567922 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.568056 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.568228 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.568355 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.568535 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.568662 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.568850 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.568976 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.569166 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.569293 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.569491 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.569634 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.569805 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.569962 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.570142 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.570268 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.570459 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.570585 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.570770 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.570907 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.571085 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.571212 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.571408 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.571541 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.571727 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.571852 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.572035 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.572161 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.572371 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.572496 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.572710 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.572845 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.573023 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.573156 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.573344 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.573470 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.573653 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.573786 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.573994 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.574122 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.574308 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.574434 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.574620 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.574754 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.574933 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.575068 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.575262 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.575395 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.575573 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.575706 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.575883 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.576008 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.576758 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.576894 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.577075 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.577203 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.577393 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.577523 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.577701 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.577829 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.578108 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.578238 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.578416 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.578543 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.578725 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.578858 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.579029 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.579157 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.579343 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.579469 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.579668 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.579802 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.579974 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.580101 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.580306 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.580433 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.580609 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.580745 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.580917 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.581045 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.581225 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.581352 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.581533 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.581671 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.581836 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.582013 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.582173 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.582301 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.582482 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.582687 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.582816 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.582938 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.583093 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.583228 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.583400 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.583536 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.583701 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.583829 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.584022 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.584150 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.584327 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.584457 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.584632 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.584761 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.584942 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.585079 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.585250 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.585380 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.585560 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.585695 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.585890 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.586020 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.586213 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.586352 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.586524 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.586651 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.586833 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.586960 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.587164 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.587292 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.587491 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.587625 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.587794 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.587929 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.588112 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.588246 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.588434 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.588568 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.588746 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.588882 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.589047 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.589174 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.589353 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.589481 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.589654 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.589785 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.589977 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.590105 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.590282 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.590411 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.590591 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.590728 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.590893 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.591019 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.591194 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.591312 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.591497 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.591633 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.591824 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.591950 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.592125 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.592261 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.592447 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.592581 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.592753 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.592887 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.593055 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.593190 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.593354 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.593481 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.593655 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.593782 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.594016 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.594154 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.594320 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.594447 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.594651 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.594778 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.594982 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.595121 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.595313 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.595437 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.595606 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.595734 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.595917 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.596053 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.596228 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.596383 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.596533 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.596660 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.596840 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.596976 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.597149 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.597276 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.597455 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.597589 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.597772 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.597944 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.598104 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.598237 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.598450 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.598588 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.598721 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.598854 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.599034 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.599170 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.599343 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.599478 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.599658 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.599785 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.599963 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.600090 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.600274 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.600422 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.600611 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.600740 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.600940 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.601067 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.601253 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.601371 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.601571 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.601699 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.601912 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.602052 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.602212 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.602341 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.602519 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.602648 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.602825 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.602953 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.603132 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.603269 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.603439 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.603565 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.603753 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.603878 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.604062 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.604189 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.604374 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.604500 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.604680 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.604807 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.604996 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.605138 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.605303 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.605431 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.605620 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.605757 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.605944 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.606091 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.606256 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.606385 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.606578 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.606706 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.606908 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.607050 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.607215 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.607343 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.607545 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.607674 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.607863 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.607984 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.608170 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.608306 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.608478 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.608615 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.608785 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.608916 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.609201 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.609339 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.609472 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.609597 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.609744 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.609933 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.610062 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.610185 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.610348 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.610487 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.610658 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.610784 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.610959 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.611086 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.611267 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.611471 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.611598 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.611721 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.611844 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.611966 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.612144 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.612281 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.612457 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.612586 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.612774 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.612903 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.613083 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.613220 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.613400 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.613529 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.613716 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.613851 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.614042 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.614184 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.614344 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.614471 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.614663 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.614790 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.614968 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.615104 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.615269 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.615397 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.615570 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.615699 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.615870 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.615999 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.616207 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.616343 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.616514 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.616642 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.616816 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.616952 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.617129 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.617263 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.617444 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.617577 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.617749 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.617907 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.618081 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.618208 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.618390 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.618529 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.618694 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.618820 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.619012 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.619142 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.619322 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.619458 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.619629 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.619748 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.619936 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.620063 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.620247 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.620382 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.620556 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.620689 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.620866 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.620992 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.621184 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.621320 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.621491 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.621609 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.621797 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.621941 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.622131 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.622261 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.622434 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.622561 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.622742 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.622868 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.623571 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.623701 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.624133 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.624261 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.624465 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.624593 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.624833 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.624960 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.625159 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.625287 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.625478 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.625606 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.625795 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.625961 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.626151 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.626278 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.626476 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.626610 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.626790 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.626923 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.627097 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.627229 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.627405 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.627539 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.627709 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.627836 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.628011 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.628138 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.628318 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.628453 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.628621 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.628746 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.628923 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.629048 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.629226 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.629361 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.629533 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.629667 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.629835 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.629978 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.630197 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.630325 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.630500 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.630635 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.630802 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.630942 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.631114 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.631247 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.631416 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.631550 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.631727 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.631852 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.632029 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.632154 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.632350 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.632488 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.632659 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.632788 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.632961 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.633088 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.633260 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.633386 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.633561 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.633694 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.633921 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.634052 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.634230 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.634357 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.634563 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.634690 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.634887 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.635020 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.635223 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.635356 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.635526 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.635651 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.635828 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.636027 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.636161 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.636286 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.636440 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.636575 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.636741 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.636875 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.637039 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.637165 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.637344 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.637469 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.637647 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.637781 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.637969 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.638097 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.638279 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.638416 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.638643 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.639288 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.639472 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.639598 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.639783 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.639912 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.640085 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.640222 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.640394 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.640522 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.640704 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.640840 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.641014 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.641140 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.641319 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.641446 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.641621 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.641747 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.641942 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.642072 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.642253 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.642379 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.642559 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.642685 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.642859 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.642986 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.643165 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.643292 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.643464 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.643598 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.643777 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.643904 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.644079 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.644205 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.644378 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.644513 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.644679 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.644805 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.644986 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.645121 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.645290 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.645425 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.645589 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.645716 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.645928 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.646057 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.646241 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.646378 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.646541 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.646669 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.646840 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.646966 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.647147 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.647281 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.647447 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.647573 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.647746 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.647873 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.648051 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.648185 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.648371 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.648497 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.648682 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.648809 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.648982 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.649116 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.649285 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.649411 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.649586 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.649712 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.649919 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.650043 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.650213 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.650342 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.650515 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.650642 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.650813 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.650947 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.651112 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.651239 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.651410 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.651544 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.651709 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.651834 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.652008 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.652143 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.652325 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.652460 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.652633 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.652764 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.652932 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.653058 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.653234 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.653368 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.653533 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.653660 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.653890 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.654019 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.654220 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.654357 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.654576 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.654705 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.654880 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.655013 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.655189 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.655316 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.655506 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.655630 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.655812 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.655939 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.656230 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.656370 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.656486 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.656594 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.656725 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.656837 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.657038 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.657169 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.657348 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.657478 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.657659 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.657786 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.657969 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.658097 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.658278 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.658412 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.658595 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.658730 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.658904 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.659038 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.659211 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.659338 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.659529 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.659664 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.659844 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.659971 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.660166 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.660292 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.660467 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.660602 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.660774 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.660902 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.661082 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.661207 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.661385 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.661775 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.661971 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.662101 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.662282 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.662413 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.662600 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.662739 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.662914 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.663043 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.663225 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.663354 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.663537 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.663674 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.663849 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.663979 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.664153 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.664283 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.664460 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.664590 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.664768 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.664897 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.665072 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.665206 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.665407 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.665541 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.665687 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.665816 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.666011 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.666160 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.666317 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.666451 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.666619 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.666747 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.666931 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.667067 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.667233 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.667360 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.667655 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.667783 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.667966 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.668102 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.668276 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.668404 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.668579 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.668707 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.668887 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.669023 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.669219 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.669368 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.669514 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.669643 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.669849 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.670021 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.670174 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.670301 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.670590 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.670719 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.670899 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.671029 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.671212 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.671341 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.671559 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.671694 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.671850 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.671977 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.672159 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.672287 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.672469 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.672597 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.672793 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.672924 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.673095 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.673221 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.673397 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.673524 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.673698 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.673846 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.674043 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.674173 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.674348 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.674486 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.674666 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.674792 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.675077 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.675204 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.675384 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.675522 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.675688 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.675815 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.676100 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.676236 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.676409 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.676544 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.676714 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.676841 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.677034 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.677164 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.677351 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.677481 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.677672 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.677799 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.677996 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.678138 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.678308 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.678459 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.678614 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.678936 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.679258 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.679568 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.679882 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.680185 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.680487 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.680623 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.680831 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.681128 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.681449 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.681858 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.682201 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.682517 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.682839 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.682977 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.683161 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.683465 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.683768 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.683894 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.684075 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.684227 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.684383 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.684522 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.684686 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.684847 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.685005 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.685192 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.685321 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.686173 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.686355 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.686566 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.686740 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.686912 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.687092 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.687280 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.687461 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.687637 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.687809 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.687983 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.688161 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.688312 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.688439 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.688564 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.688697 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.688818 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.688955 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.689081 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.689209 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.689334 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.689458 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.689581 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.689714 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.689901 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.690057 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.690211 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.690388 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.690517 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.690702 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.690832 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.691021 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.691149 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.691338 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.691467 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.691652 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.691783 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.691961 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.692091 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.692268 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.692405 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.692595 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.692724 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.692904 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.693041 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.693230 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.693367 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.693547 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.693676 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.693890 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.694033 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.694212 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.694350 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.694521 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.694658 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.694822 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.694951 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.695124 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.695263 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.695434 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.695565 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.695738 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.695868 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.696043 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.696244 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.696381 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.696508 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.696632 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.696763 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.696926 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.697057 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.697227 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.697356 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.697530 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.697687 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.697849 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.698015 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.698178 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.698344 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.698530 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.698662 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.698801 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.698974 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.699104 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.699292 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.699423 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.699617 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.699747 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.699921 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.700050 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.700228 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.700357 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.700535 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.700664 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.700838 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.700967 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.701683 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.701815 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.702016 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.702155 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.702326 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.702455 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.702630 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.702760 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.702937 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.703095 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.703223 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.703388 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.703546 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.703705 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.703855 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.704021 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.704177 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.704339 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.704488 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.704657 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.704786 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.704974 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.705102 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.705284 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.705414 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.705600 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.705729 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.705937 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.706069 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.706255 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.706384 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.706645 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.706782 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.706970 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.707099 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.707298 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.707436 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.707607 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.707735 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.707980 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.708109 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.708334 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.708504 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.708653 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.708782 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.708964 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.709093 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.709273 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.709412 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.709582 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.709712 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.709909 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.710053 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.710240 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.710378 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.710550 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.710678 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.710869 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.711005 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.711187 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.711316 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.711504 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.711635 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.711818 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.712025 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.712164 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.712355 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.712502 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.712669 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.712811 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.712981 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.713110 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.713293 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.713429 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.713606 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.713742 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.713940 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.714072 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.714253 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.714383 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.714594 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.714730 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.714904 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.715034 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.715216 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.715345 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.715567 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.715696 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.715869 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.716004 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.716177 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.716308 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.716490 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.716650 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.716827 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.716965 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.717149 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.717278 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.717482 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.717621 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.717799 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.717982 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.718134 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.718263 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.718521 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.718651 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.718838 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.718968 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.719146 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.719352 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.719494 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.719666 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.719795 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.719999 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.720130 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.720324 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.720463 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.720648 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.720770 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.720958 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.721085 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.721271 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.721401 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.721583 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.721711 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.721899 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.722029 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.722211 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.722348 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.722521 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.722656 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.722830 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.722968 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.723138 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.723269 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.723456 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.723574 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.723762 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.723902 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.724065 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.724194 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.724384 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.724615 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.724751 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.724962 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.725203 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.725333 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.725546 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.725678 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.725858 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.726019 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.726202 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.726331 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.726525 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.726654 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.726838 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.726977 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.727142 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.727271 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.727460 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.727591 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.727763 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.727893 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.728065 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.728201 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.728367 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.728495 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.728673 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.728802 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.728975 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.729104 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.729277 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.729404 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.729582 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.729710 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.729905 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.730037 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.730211 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.730435 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.730577 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.730781 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.730902 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.731106 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.731243 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.731412 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.731522 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.731714 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.731820 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.732016 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.732140 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.732351 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.732482 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.732657 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.732795 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.732966 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.733102 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.733269 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.733399 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.733574 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.733703 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.733897 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.734029 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.734300 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.734429 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.734606 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.734737 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.734912 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.735048 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.735223 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.735365 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.735524 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.735651 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.735830 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.735966 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.736132 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.736259 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.736453 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.736581 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.736755 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.737075 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.737220 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.737347 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.737347 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.737583 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.737715 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.737858 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.738010 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.738152 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.738279 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.738415 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.738549 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.738684 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.738833 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.738963 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.739143 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.739281 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.739447 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.739754 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.739890 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.740060 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.740189 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.740370 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.740507 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.740675 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.740812 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.740984 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.741113 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.741287 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.741424 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.741612 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.741752 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.741937 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.742065 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.742228 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.742367 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.742543 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.742671 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.742852 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.742989 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.743164 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.743294 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.743472 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.743600 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.743780 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.743907 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.744109 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.744238 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.744384 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.744513 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.744691 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.744983 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.745128 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.745292 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.745419 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.745601 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.745730 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.745942 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.746087 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.746283 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.746413 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.746596 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.746728 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.746906 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.747036 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.747214 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.747352 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.747530 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.747658 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.747856 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.748485 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.748702 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.748838 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.749013 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.749151 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.749323 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.749464 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.749661 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.749789 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.750000 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.750141 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.750311 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.750441 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.750624 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.750765 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.750934 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.751076 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.751243 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.751373 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.751554 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.751691 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.751896 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.752025 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.752193 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.752323 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.752515 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.752654 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.752835 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.752965 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.753151 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.753293 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.753468 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.753599 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.753774 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.753923 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.754115 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.754243 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.754426 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.754556 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.754735 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.754866 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.755056 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.755193 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.755368 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.755505 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.755671 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.755793 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.755974 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.756102 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.756280 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.756418 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.756609 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.756747 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.756939 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.757069 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.757252 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.757392 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.757571 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.757709 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.757919 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.758064 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.758221 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.758353 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.758529 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.758660 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.758850 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.758981 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.759171 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.759310 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.759486 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.759626 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.759797 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.759935 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.760125 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.760256 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.760434 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.760564 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.760745 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.760882 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.761057 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.761179 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.761365 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.761505 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.761672 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.761810 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.762002 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.762133 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.762326 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.762457 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.762649 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.762787 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.762959 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.763090 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.763282 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.763412 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.764135 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.764271 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.764458 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.764595 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.764774 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.764903 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.765086 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.765228 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.765398 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.765534 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.765707 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.765845 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.766064 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.766206 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.766416 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.766544 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.766733 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.766868 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.767049 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.767184 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.767367 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.767498 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.767696 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.767835 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.768019 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.768155 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.768345 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.768474 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.768668 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.768804 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.768974 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.769105 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.769301 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.769477 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.769612 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.769748 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.769950 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.770082 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.770268 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.770411 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.770580 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.770710 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.770886 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.771015 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.771140 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 20:17:46.771265 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.771510 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.771822 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.772171 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.772553 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.772917 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.773245 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.773572 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.773915 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.774246 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.774595 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.774908 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.775252 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.775578 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.775893 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.776206 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.776513 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:17:46.776754 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 20:17:46.793907 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:17:46.799858 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_db.sqlalchemy.engines [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:17:46.857789 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.context [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87872759-4d17-418e-b91c-df15c67a4efe(cell1) {{(pid=101639) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 20:17:46.862037 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG oslo_concurrency.lockutils [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:17:46.862210 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.context [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87872759-4d17-418e-b91c-df15c67a4efe(cell1) {{(pid=101640) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 20:17:46.863626 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG oslo_concurrency.lockutils [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:17:46.864435 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG oslo_concurrency.lockutils [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:17:46.866403 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG oslo_concurrency.lockutils [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:17:46.866505 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:17:46.867994 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:17:46.868835 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:17:46.870814 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:17:46.877482 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:17:46.881079 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:17:46.884260 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_db.sqlalchemy.engines [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:17:46.887155 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_db.sqlalchemy.engines [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:17:47.041916 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:17:47.048365 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_db.sqlalchemy.engines [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:17:47.384092 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: WARNING keystonemiddleware.auth_token [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 20:17:47.390560 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: WARNING keystonemiddleware.auth_token [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 20:17:47.393078 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: WARNING keystonemiddleware.auth_token [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 20:17:47.399537 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: WARNING keystonemiddleware.auth_token [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 20:17:47.751885 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: WARNING keystonemiddleware.auth_token [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 20:17:47.756810 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: WARNING keystonemiddleware.auth_token [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 20:17:47.757182 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: WARNING keystonemiddleware.auth_token [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 20:17:47.762093 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: WARNING keystonemiddleware.auth_token [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 20:17:47.766139 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b662bd99c0 pid: 101640 (default app) Jan 28 20:17:47.768169 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b662bd99c0 pid: 101639 (default app) Jan 28 20:17:47.769785 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:17:47.771095 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-eb7977db-d872-4e30-b55c-834eab7f2793 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002623 Jan 28 20:17:47.771519 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Fri Jan 28 20:17:47 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:12.986701 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:12.988698 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002607 Jan 28 20:19:12.990228 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:13.422837 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-1df08b00-4fe9-44d2-b539-bc461812155f admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:13.452539 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-1df08b00-4fe9-44d2-b539-bc461812155f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.457379 Jan 28 20:19:13.453283 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 2/3] 10.222.0.59 () {60 vars in 1291 bytes} [Fri Jan 28 20:19:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:19:15.732742 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:15.734545 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-5dd654a1-1247-4ad4-a201-e941206be961 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001878 Jan 28 20:19:15.735099 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 2/4] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:15.800974 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-1c0942ea-2a3a-407b-a426-f388a9778851 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:15.820015 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:19:15.820015 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: warnings.warn(msg) Jan 28 20:19:15.852892 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-1c0942ea-2a3a-407b-a426-f388a9778851 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108474 Jan 28 20:19:15.854092 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 3/5] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:19:16.076834 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-f69c00d0-002f-4a85-a761-848f82ac2822 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:16.079258 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:19:16.079258 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: warnings.warn(msg) Jan 28 20:19:16.129951 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-f69c00d0-002f-4a85-a761-848f82ac2822 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267429 Jan 28 20:19:16.130779 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 3/6] 10.222.0.59 () {64 vars in 1335 bytes} [Fri Jan 28 20:19:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:19:18.377893 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-1c0942ea-2a3a-407b-a426-f388a9778851 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:18.378920 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-1c0942ea-2a3a-407b-a426-f388a9778851 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jan 28 20:19:18.379341 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 4/7] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:18.486541 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-2dcec131-176e-4447-b267-bde26a12a9f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:18.503987 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:19:18.503987 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: warnings.warn(msg) Jan 28 20:19:18.522907 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-2dcec131-176e-4447-b267-bde26a12a9f0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137932 Jan 28 20:19:18.523460 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 4/8] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 20:19:18.535744 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-be6d55f2-6b1c-4d75-b5d5-e645058e1ee6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:18.537214 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:19:18.537214 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: warnings.warn(msg) Jan 28 20:19:18.582909 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-be6d55f2-6b1c-4d75-b5d5-e645058e1ee6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050750 Jan 28 20:19:18.590725 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 5/9] 10.222.0.59 () {64 vars in 1335 bytes} [Fri Jan 28 20:19:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:19:20.864087 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-2dcec131-176e-4447-b267-bde26a12a9f0 admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:20.865232 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-2dcec131-176e-4447-b267-bde26a12a9f0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jan 28 20:19:20.865790 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:20.928355 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-27e2a0be-7b80-42e7-bef4-46aa10198c79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "disk": 10, "id": "d2", "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:20.949737 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-27e2a0be-7b80-42e7-bef4-46aa10198c79 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077068 Jan 28 20:19:20.950445 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 6/11] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:19:20.964049 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-ffbfb74a-bed2-4c09-b18c-7eabcbb87d5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:20.991461 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-ffbfb74a-bed2-4c09-b18c-7eabcbb87d5b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032765 Jan 28 20:19:20.992364 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 6/12] 10.222.0.59 () {64 vars in 1335 bytes} [Fri Jan 28 20:19:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:19:23.267207 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-27e2a0be-7b80-42e7-bef4-46aa10198c79 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:23.268208 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-27e2a0be-7b80-42e7-bef4-46aa10198c79 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jan 28 20:19:23.268605 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 7/13] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:23.329408 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-941fffe6-7edb-47e2-b41e-bcf0f16e4db1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:23.348194 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-941fffe6-7edb-47e2-b41e-bcf0f16e4db1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073837 Jan 28 20:19:23.348936 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 7/14] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 20:19:23.360371 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-7a666c60-ca8e-498a-a7e2-011e1c06c711 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:23.382909 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-7a666c60-ca8e-498a-a7e2-011e1c06c711 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026146 Jan 28 20:19:23.383483 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 8/15] 10.222.0.59 () {64 vars in 1335 bytes} [Fri Jan 28 20:19:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:19:25.648123 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-941fffe6-7edb-47e2-b41e-bcf0f16e4db1 admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:25.649139 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-941fffe6-7edb-47e2-b41e-bcf0f16e4db1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jan 28 20:19:25.649540 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 8/16] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:25.709406 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-c27c41fc-8667-4ae3-a794-6ed7bdc412c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:25.728692 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-c27c41fc-8667-4ae3-a794-6ed7bdc412c9 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072862 Jan 28 20:19:25.729421 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 9/17] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:19:25.741088 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-c84ff892-6806-4e73-acbe-091952407271 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:25.764812 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-c84ff892-6806-4e73-acbe-091952407271 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027430 Jan 28 20:19:25.765585 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 9/18] 10.222.0.59 () {64 vars in 1335 bytes} [Fri Jan 28 20:19:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:19:28.055458 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-c27c41fc-8667-4ae3-a794-6ed7bdc412c9 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:28.056451 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-c27c41fc-8667-4ae3-a794-6ed7bdc412c9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jan 28 20:19:28.057054 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 10/19] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:28.120436 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-59692259-8794-4528-8270-64c1b45442e4 admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:28.149131 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-59692259-8794-4528-8270-64c1b45442e4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086031 Jan 28 20:19:28.149668 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 10/20] 10.222.0.59 () {60 vars in 1291 bytes} [Fri Jan 28 20:19:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:19:30.921742 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-c27c41fc-8667-4ae3-a794-6ed7bdc412c9 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:30.922797 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-c27c41fc-8667-4ae3-a794-6ed7bdc412c9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jan 28 20:19:30.923384 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 11/21] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:30.985270 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-0fea75e4-59db-4256-8451-273802115626 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "id": "1", "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:31.006499 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-0fea75e4-59db-4256-8451-273802115626 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077382 Jan 28 20:19:31.007303 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 11/22] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:19:31.020105 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-8232e66d-6907-4b10-9bf7-ea1fc88ee523 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:31.045829 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-8232e66d-6907-4b10-9bf7-ea1fc88ee523 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030492 Jan 28 20:19:31.046459 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 12/23] 10.222.0.59 () {64 vars in 1332 bytes} [Fri Jan 28 20:19:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:19:33.320138 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-0fea75e4-59db-4256-8451-273802115626 admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:33.321270 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-0fea75e4-59db-4256-8451-273802115626 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jan 28 20:19:33.321530 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 12/24] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:33.391355 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-2800dd2c-a9a6-4686-ac06-2699e40658f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "id": "2"}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:33.410768 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-2800dd2c-a9a6-4686-ac06-2699e40658f4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082853 Jan 28 20:19:33.411379 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 13/25] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:19:33.423684 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-83d08f85-e4be-4ddc-92c2-8a62838f02d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:33.447555 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-83d08f85-e4be-4ddc-92c2-8a62838f02d6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027249 Jan 28 20:19:33.448326 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 13/26] 10.222.0.59 () {64 vars in 1332 bytes} [Fri Jan 28 20:19:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:19:35.857217 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-2800dd2c-a9a6-4686-ac06-2699e40658f4 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:35.860284 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-2800dd2c-a9a6-4686-ac06-2699e40658f4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jan 28 20:19:35.860284 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 14/27] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:35.917047 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-111003d4-bb0b-4c4e-8533-19c58a1b97bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:35.935153 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-111003d4-bb0b-4c4e-8533-19c58a1b97bd admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070632 Jan 28 20:19:35.935697 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 14/28] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:19:35.947191 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-a8ebbeac-45c7-4669-abd9-9ce971abc105 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:35.969485 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-a8ebbeac-45c7-4669-abd9-9ce971abc105 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025971 Jan 28 20:19:35.970087 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 15/29] 10.222.0.59 () {64 vars in 1332 bytes} [Fri Jan 28 20:19:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:19:38.226769 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-111003d4-bb0b-4c4e-8533-19c58a1b97bd admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:38.229946 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-111003d4-bb0b-4c4e-8533-19c58a1b97bd admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003505 Jan 28 20:19:38.230361 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 15/30] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:38.305619 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-8b3007db-82a6-465f-9de2-41506c5616c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "swap": 0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:38.325389 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-8b3007db-82a6-465f-9de2-41506c5616c4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082257 Jan 28 20:19:38.332685 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 16/31] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 20:19:38.337495 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-8779c2e1-3d4c-4851-b5fe-4f908bd59941 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:38.362797 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-8779c2e1-3d4c-4851-b5fe-4f908bd59941 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028846 Jan 28 20:19:38.363632 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 16/32] 10.222.0.59 () {64 vars in 1332 bytes} [Fri Jan 28 20:19:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:19:40.652110 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-8b3007db-82a6-465f-9de2-41506c5616c4 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:19:40.653202 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-8b3007db-82a6-465f-9de2-41506c5616c4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jan 28 20:19:40.653681 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 17/33] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:19:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:19:40.718867 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-574fb103-a165-43fb-9faf-47388ac2d64f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:40.736747 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-574fb103-a165-43fb-9faf-47388ac2d64f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076198 Jan 28 20:19:40.737382 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 17/34] 10.222.0.59 () {64 vars in 1282 bytes} [Fri Jan 28 20:19:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:19:40.749451 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-e4a94be8-a0ec-4868-af5a-f3a2b2b704dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:19:40.772432 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-e4a94be8-a0ec-4868-af5a-f3a2b2b704dc admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026533 Jan 28 20:19:40.773006 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 18/35] 10.222.0.59 () {64 vars in 1332 bytes} [Fri Jan 28 20:19:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:20:02.811100 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-574fb103-a165-43fb-9faf-47388ac2d64f admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:02.812160 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-574fb103-a165-43fb-9faf-47388ac2d64f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 28 20:20:02.812547 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 18/36] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:20:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:20:02.868664 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-e4d1cf29-d44b-47fd-beb1-d27d0c4da12f admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:02.884994 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-e4d1cf29-d44b-47fd-beb1-d27d0c4da12f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066434 Jan 28 20:20:02.885522 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 19/37] 10.222.0.59 () {60 vars in 1291 bytes} [Fri Jan 28 20:20:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:20:04.260426 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-574fb103-a165-43fb-9faf-47388ac2d64f admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:04.261427 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-574fb103-a165-43fb-9faf-47388ac2d64f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jan 28 20:20:04.261829 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 19/38] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:20:04.458879 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-8e2e05da-ef63-4fb2-95ec-cf25eb3f97d8 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:04.467514 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.wsgi [None req-8e2e05da-ef63-4fb2-95ec-cf25eb3f97d8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 20:20:04.468077 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-8e2e05da-ef63-4fb2-95ec-cf25eb3f97d8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:20:04.468857 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-8e2e05da-ef63-4fb2-95ec-cf25eb3f97d8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063876 Jan 28 20:20:04.469373 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 20/39] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Jan 28 20:20:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 20:20:04.479202 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-63bcd674-4e2a-4a15-bb15-d9350874126c admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:04.499910 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-63bcd674-4e2a-4a15-bb15-d9350874126c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024570 Jan 28 20:20:04.500379 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 20/40] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Jan 28 20:20:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:20:04.510235 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-6fde6406-2bda-4ee4-adfd-3fe39c19bd17 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:04.530953 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-6fde6406-2bda-4ee4-adfd-3fe39c19bd17 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024173 Jan 28 20:20:04.531509 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 21/41] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Jan 28 20:20:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:20:04.541720 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-b76b1fc2-aa1e-4604-9e0d-fb837a70b64b admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:04.547161 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.wsgi [None req-b76b1fc2-aa1e-4604-9e0d-fb837a70b64b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 20:20:04.547720 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-b76b1fc2-aa1e-4604-9e0d-fb837a70b64b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:20:04.548498 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-b76b1fc2-aa1e-4604-9e0d-fb837a70b64b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010813 Jan 28 20:20:04.549001 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 21/42] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Jan 28 20:20:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 20:20:05.831099 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-6fde6406-2bda-4ee4-adfd-3fe39c19bd17 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:05.832090 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-6fde6406-2bda-4ee4-adfd-3fe39c19bd17 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jan 28 20:20:05.832481 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 22/43] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:20:06.025820 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-d08d0a01-7d39-4852-b4a3-8817ef7d839b admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:06.031607 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.wsgi [None req-d08d0a01-7d39-4852-b4a3-8817ef7d839b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 20:20:06.032226 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-d08d0a01-7d39-4852-b4a3-8817ef7d839b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:20:06.033304 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-d08d0a01-7d39-4852-b4a3-8817ef7d839b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058845 Jan 28 20:20:06.033823 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 22/44] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Jan 28 20:20:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 20:20:06.043200 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-32019617-bf55-4297-8c47-2dc6ed9530b3 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:06.056273 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-32019617-bf55-4297-8c47-2dc6ed9530b3 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016798 Jan 28 20:20:06.056784 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 23/45] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Jan 28 20:20:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:20:06.066147 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-731e6f4c-ab3a-4a69-bf6a-3719ad35a72b admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:06.079782 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-731e6f4c-ab3a-4a69-bf6a-3719ad35a72b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017149 Jan 28 20:20:06.080303 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 23/46] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Jan 28 20:20:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:20:06.089600 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-49adc3ff-81c1-4def-baba-22b0719777b3 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:06.094623 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.wsgi [None req-49adc3ff-81c1-4def-baba-22b0719777b3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 20:20:06.095170 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-49adc3ff-81c1-4def-baba-22b0719777b3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:20:06.095929 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-49adc3ff-81c1-4def-baba-22b0719777b3 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010250 Jan 28 20:20:06.096403 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 24/47] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Jan 28 20:20:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 20:20:07.378115 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-731e6f4c-ab3a-4a69-bf6a-3719ad35a72b admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:07.379153 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-731e6f4c-ab3a-4a69-bf6a-3719ad35a72b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jan 28 20:20:07.379539 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 24/48] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:20:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:20:07.569723 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-3e988d95-15ba-4d91-9110-8fbed8b8c6aa admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:07.575434 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.wsgi [None req-3e988d95-15ba-4d91-9110-8fbed8b8c6aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 20:20:07.575986 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-3e988d95-15ba-4d91-9110-8fbed8b8c6aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:20:07.576766 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-3e988d95-15ba-4d91-9110-8fbed8b8c6aa admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057206 Jan 28 20:20:07.577266 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 25/49] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Jan 28 20:20:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 20:20:07.586636 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-aa798136-76d6-43ea-a4ba-4a353e2bb9b8 admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:07.600093 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-aa798136-76d6-43ea-a4ba-4a353e2bb9b8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016996 Jan 28 20:20:07.600604 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 25/50] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Jan 28 20:20:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:20:07.609978 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:07.622532 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016310 Jan 28 20:20:07.623041 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 26/51] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Jan 28 20:20:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:20:07.631642 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-8ab90f56-6287-4152-be82-ef74834ad43a admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:07.637299 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.wsgi [None req-8ab90f56-6287-4152-be82-ef74834ad43a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 20:20:07.637846 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-8ab90f56-6287-4152-be82-ef74834ad43a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:20:07.638772 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-8ab90f56-6287-4152-be82-ef74834ad43a admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010549 Jan 28 20:20:07.639250 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 26/52] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Jan 28 20:20:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 20:20:08.905127 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:08.906205 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jan 28 20:20:08.906631 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 27/53] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:20:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:20:09.102057 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-f637928a-baea-45f2-9d65-a40705a8b57e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:20:09.121070 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-f637928a-baea-45f2-9d65-a40705a8b57e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073195 Jan 28 20:20:09.121611 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 27/54] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Jan 28 20:20:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:20:10.425214 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:10.426218 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001388 Jan 28 20:20:10.426612 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 28/55] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:20:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:20:10.616367 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-c9594e4a-9c3b-4784-93f0-0a18b41dfde6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:20:10.634275 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-c9594e4a-9c3b-4784-93f0-0a18b41dfde6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067597 Jan 28 20:20:10.634739 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 28/56] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Jan 28 20:20:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 20:20:11.896255 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:11.897240 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jan 28 20:20:11.897661 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 29/57] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:20:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:20:12.088649 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-6c58284f-c4c0-4ccc-8eec-241bd0e30dd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:20:12.107432 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-6c58284f-c4c0-4ccc-8eec-241bd0e30dd6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069415 Jan 28 20:20:12.107899 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 29/58] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Jan 28 20:20:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:20:13.369592 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:13.370619 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jan 28 20:20:13.371015 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 30/59] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:20:13.568411 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-86c431d7-4129-4c15-8588-64c36494bc3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:20:13.585055 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-86c431d7-4129-4c15-8588-64c36494bc3f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067635 Jan 28 20:20:13.585530 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 30/60] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Jan 28 20:20:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 20:20:14.861408 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:14.862425 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jan 28 20:20:14.862819 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 31/61] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:20:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:20:15.053364 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-ec2de0cf-9923-472e-a419-01369984c5f1 admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:20:15.072382 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-ec2de0cf-9923-472e-a419-01369984c5f1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069288 Jan 28 20:20:15.072846 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 31/62] 10.222.0.59 () {60 vars in 1202 bytes} [Fri Jan 28 20:20:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:21:00.964231 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:21:00.965217 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-94c12f39-4e75-4d13-bc32-e30ef0eca236 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Jan 28 20:21:00.965613 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 32/63] 10.222.0.59 () {54 vars in 930 bytes} [Fri Jan 28 20:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:21:01.021464 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-1792302b-a412-4c28-bd14-cf805e12d432 admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:21:01.041834 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-1792302b-a412-4c28-bd14-cf805e12d432 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070313 Jan 28 20:21:01.042384 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 32/64] 10.222.0.59 () {60 vars in 1291 bytes} [Fri Jan 28 20:21:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:21:01.064524 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-79406f31-fc4f-4897-bd75-2f7231cdfd35 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:21:01.074126 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-79406f31-fc4f-4897-bd75-2f7231cdfd35 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011905 Jan 28 20:21:01.076247 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 33/65] 10.222.0.59 () {60 vars in 1282 bytes} [Fri Jan 28 20:21:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:21:01.088137 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-59f36f6c-4040-431a-8962-6c764c4613b4 admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:21:01.095774 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-59f36f6c-4040-431a-8962-6c764c4613b4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011259 Jan 28 20:21:01.096293 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 33/66] 10.222.0.59 () {60 vars in 1285 bytes} [Fri Jan 28 20:21:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:21:01.107247 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-ac44e303-1787-44b9-92ce-1ca3f6b76cde admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:21:01.114536 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-ac44e303-1787-44b9-92ce-1ca3f6b76cde admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010739 Jan 28 20:21:01.115036 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 34/67] 10.222.0.59 () {60 vars in 1285 bytes} [Fri Jan 28 20:21:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:21:01.126175 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:21:01.134217 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011368 Jan 28 20:21:01.134728 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 34/68] 10.222.0.59 () {60 vars in 1282 bytes} [Fri Jan 28 20:21:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:22:42.076452 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-79de3d1f-de07-4bce-807c-52ff6919f040 tempest-verify_tempest_config-997525725 tempest-verify_tempest_config-997525725-project] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:22:42.078411 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-79de3d1f-de07-4bce-807c-52ff6919f040 tempest-verify_tempest_config-997525725 tempest-verify_tempest_config-997525725-project] 10.222.0.59 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103148 Jan 28 20:22:42.078935 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 35/69] 10.222.0.59 () {58 vars in 1133 bytes} [Fri Jan 28 20:22:41 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:24:13.044618 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:24:13.045630 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jan 28 20:24:13.046088 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 35/70] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:24:13.295139 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-2919cc8a-fe8f-43d8-9623-8fff1e5e5e22 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:24:13.296358 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:24:13.296358 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: warnings.warn(msg) Jan 28 20:24:13.297976 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-2919cc8a-fe8f-43d8-9623-8fff1e5e5e22 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:24:13.298413 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-2919cc8a-fe8f-43d8-9623-8fff1e5e5e22 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:24:13.299232 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-2919cc8a-fe8f-43d8-9623-8fff1e5e5e22 admin admin] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:24:13.299675 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-2919cc8a-fe8f-43d8-9623-8fff1e5e5e22 admin admin] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:24:13.333122 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-2919cc8a-fe8f-43d8-9623-8fff1e5e5e22 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146518 Jan 28 20:24:13.334301 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 36/71] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Jan 28 20:24:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:24:14.630808 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:24:14.631861 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Jan 28 20:24:14.632357 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 36/72] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:24:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:24:14.823778 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-c7998581-a464-45de-9926-3d2ebc61f169 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:24:14.824936 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:24:14.824936 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: warnings.warn(msg) Jan 28 20:24:14.826501 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-c7998581-a464-45de-9926-3d2ebc61f169 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:24:14.826962 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-c7998581-a464-45de-9926-3d2ebc61f169 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:24:14.827744 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-c7998581-a464-45de-9926-3d2ebc61f169 admin admin] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:24:14.828162 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-c7998581-a464-45de-9926-3d2ebc61f169 admin admin] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:24:14.846450 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-c7998581-a464-45de-9926-3d2ebc61f169 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073364 Jan 28 20:24:14.846920 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 37/73] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Jan 28 20:24:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:24:26.618855 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:24:26.619938 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jan 28 20:24:26.620331 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 37/74] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:24:26.817173 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-bdcca6b2-975b-49d5-9a06-188f95de7a09 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:24:26.818307 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:24:26.818307 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: warnings.warn(msg) Jan 28 20:24:26.819799 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-bdcca6b2-975b-49d5-9a06-188f95de7a09 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:24:26.820233 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-bdcca6b2-975b-49d5-9a06-188f95de7a09 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:24:26.821013 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-bdcca6b2-975b-49d5-9a06-188f95de7a09 admin admin] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:24:26.822019 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-bdcca6b2-975b-49d5-9a06-188f95de7a09 admin admin] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:24:26.846836 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-bdcca6b2-975b-49d5-9a06-188f95de7a09 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079766 Jan 28 20:24:26.847389 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 38/75] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Jan 28 20:24:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:24:28.140938 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: DEBUG nova.api.openstack.wsgi [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] Calling method '>' {{(pid=101639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:24:28.141989 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: INFO nova.api.openstack.requestlog [None req-2d39267f-1220-48a1-a665-b4f4ac05090c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jan 28 20:24:28.142388 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: [pid: 101639|app: 0|req: 38/76] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Jan 28 20:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:24:28.336757 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG nova.api.openstack.wsgi [None req-7c9031a6-a740-45a8-82c8-d31a06af0928 admin admin] Calling method '>' {{(pid=101640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:24:28.338059 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:24:28.338059 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: warnings.warn(msg) Jan 28 20:24:28.339588 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-7c9031a6-a740-45a8-82c8-d31a06af0928 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:24:28.340030 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-7c9031a6-a740-45a8-82c8-d31a06af0928 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:24:28.340832 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-7c9031a6-a740-45a8-82c8-d31a06af0928 admin admin] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:24:28.341260 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: DEBUG oslo_concurrency.lockutils [None req-7c9031a6-a740-45a8-82c8-d31a06af0928 admin admin] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:24:28.362954 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: INFO nova.api.openstack.requestlog [None req-7c9031a6-a740-45a8-82c8-d31a06af0928 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079345 Jan 28 20:24:28.363446 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: [pid: 101640|app: 0|req: 39/77] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Jan 28 20:24:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:25:26.729737 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: Fri Jan 28 20:25:26 2022 - graceful shutdown triggered... Jan 28 20:25:26.730279 dv-cinder-826350-4-iscsi devstack@n-api.service[101640]: Gracefully killing worker 2 (pid: 101640)... Jan 28 20:25:26.730643 dv-cinder-826350-4-iscsi devstack@n-api.service[101639]: Gracefully killing worker 1 (pid: 101639)... Jan 28 20:25:26.732585 dv-cinder-826350-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 28 20:25:27.730905 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: worker 1 buried after 1 seconds Jan 28 20:25:27.731405 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: worker 2 buried after 1 seconds Jan 28 20:25:27.731405 dv-cinder-826350-4-iscsi devstack@n-api.service[101638]: goodbye to uWSGI. Jan 28 20:25:27.732483 dv-cinder-826350-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 28 20:25:27.733038 dv-cinder-826350-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 28 20:25:27.735842 dv-cinder-826350-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 20:25:27.744950 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 20:25:27.747593 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 20:25:27 2022] *** Jan 28 20:25:27.747748 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: nodename: dv-cinder-826350-4-iscsi Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: machine: x86_64 Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: clock source: unix Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: pcre jit disabled Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: detected number of CPU cores: 4 Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: current working directory: / Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: detected binary path: /usr/bin/uwsgi-core Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: your processes number limit is 47680 Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: your memory page size is 4096 bytes Jan 28 20:25:27.747898 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: detected max file descriptor number: 2048 Jan 28 20:25:27.748577 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: lock engine: pthread robust mutexes Jan 28 20:25:27.748577 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: thunder lock: enabled Jan 28 20:25:27.748577 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 20:25:27.748577 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 20:25:27.794454 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: Python main interpreter initialized at 0x55672e0c09c0 Jan 28 20:25:27.794454 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: python threads support enabled Jan 28 20:25:27.794454 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: your server socket listen backlog is limited to 100 connections Jan 28 20:25:27.794454 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: your mercy for graceful operations on workers is 90 seconds Jan 28 20:25:27.794870 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 20:25:27.794870 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: *** Operational MODE: preforking *** Jan 28 20:25:27.796091 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: *** uWSGI is running in multiple interpreter mode *** Jan 28 20:25:27.796091 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: spawned uWSGI master process (pid: 116257) Jan 28 20:25:27.796091 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: spawned uWSGI worker 1 (pid: 116275, cores: 1) Jan 28 20:25:27.796091 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: spawned uWSGI worker 2 (pid: 116276, cores: 1) Jan 28 20:25:27.796091 dv-cinder-826350-4-iscsi devstack@n-api.service[116257]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 20:25:27.795367 dv-cinder-826350-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 20:25:29.759524 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 20:25:29.759524 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: from cryptography.utils import int_from_bytes Jan 28 20:25:29.760203 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 20:25:29.760203 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: from cryptography.utils import int_from_bytes Jan 28 20:25:29.762171 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 20:25:29.762171 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: from cryptography.utils import int_from_bytes Jan 28 20:25:29.762665 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 20:25:29.762665 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: from cryptography.utils import int_from_bytes Jan 28 20:25:32.221291 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 20:25:32.222107 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 20:25:32.222107 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 20:25:32.222484 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 20:25:32.222741 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 20:25:32.223130 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.223459 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.223782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.224105 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.224437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.224592 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 20:25:32.224974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.225067 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 20:25:32.225149 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.225351 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 20:25:32.225460 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.225682 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.225779 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 20:25:32.225965 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.226072 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 20:25:32.226284 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.226383 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.226609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-4-iscsi {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.226699 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.226926 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.227028 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.227237 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.227335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.227549 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.227639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.227867 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.227962 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.228171 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.228269 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.228494 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.228594 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.228803 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.228923 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.229155 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.229311 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.230797 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.230968 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.231119 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-4-iscsi {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.231240 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.231434 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.231596 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.231755 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.231906 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.232042 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.232198 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.232361 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.232493 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.232649 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.232806 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.232931 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.233080 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.233236 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.233370 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.233514 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.234314 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.234469 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.234630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-4-iscsi {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.234752 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.234907 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.235026 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.235175 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.235308 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.235472 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.235640 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.235640 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.235998 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.236095 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.236445 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.236544 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.236674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.236758 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.236836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.236931 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237012 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237012 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237164 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-4-iscsi {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237256 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237380 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237481 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237759 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.237839 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.238017 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.238102 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.238188 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.238304 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.238402 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.238620 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.238755 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.238942 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.239042 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.239370 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.239478 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.239560 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.239672 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.239797 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.240032 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.240187 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.240356 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.240488 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.240736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.240916 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.241070 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.241224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.241480 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.241655 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.241807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.242058 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.242205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.242356 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.242508 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.242660 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.242836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.242993 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.243149 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.243291 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.243446 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.243596 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.243748 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.243903 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.244044 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.244193 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.244347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.244488 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.244632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.244773 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246234 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246234 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246389 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246461 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246529 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246603 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246682 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246760 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246912 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.246980 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.247054 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.247136 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.247213 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.247292 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.247676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.247753 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.247830 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.247901 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.247969 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.248043 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.248118 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.248193 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.248393 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.248561 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.248713 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.248869 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.249015 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.249158 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.250201 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.250396 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.250396 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.250958 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.251222 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.251439 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.251439 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.251719 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.251865 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.252016 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.252159 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.252305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.252457 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.252607 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.252757 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.252757 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.253034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.253191 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.253332 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.253471 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.253610 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.253756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.253923 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.254013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.254102 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.254190 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.254271 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.254409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.254586 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.254720 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.254930 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.255026 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.255247 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.255336 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.255506 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.255602 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.255818 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.255906 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.256136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.256224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.256521 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.256628 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.256784 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.256882 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.257105 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.257390 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.257390 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.257630 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.257730 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.257824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.258023 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.258130 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.258344 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.258442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.258654 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.258742 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.258961 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.259056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.259275 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.259369 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.259583 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.259677 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.259892 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.259986 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.260206 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.260307 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.260519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.260615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.260829 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.260949 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.261148 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.261244 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.261451 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.261547 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.261762 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.261849 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.262104 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.262208 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.262414 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.262510 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.262723 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.262882 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.263031 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.263131 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.263338 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.263426 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.263647 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.263744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.263955 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.264053 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.264262 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.264359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.264569 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.264665 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.264901 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.265009 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.265214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.265550 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.265654 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.265851 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.266051 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.266188 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.266277 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.266516 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.266607 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.266833 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.266923 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.267152 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.267240 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.267504 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.267618 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.267774 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.267870 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.268086 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.268248 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.268398 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.268573 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.268710 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.268913 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.269011 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.269303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.269411 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.269578 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.269844 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.269973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.270382 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.270498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.270579 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.270658 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.270981 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.271073 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.271173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.271260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.271487 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.271565 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 20:25:32.272526 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.272642 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.272730 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.272800 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.272867 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.272942 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.272942 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.273084 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.273166 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.273287 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.273598 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.273784 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.273943 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.274220 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.274321 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.274558 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.274636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.278764 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.278764 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.278764 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279030 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279110 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279187 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279257 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279323 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279390 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279456 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279532 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279601 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279743 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279809 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279885 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.279961 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.280028 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.280102 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.280175 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.280249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.280344 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.281245 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.281347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.281678 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.281765 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.281842 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282090 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282160 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282236 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282311 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282380 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282539 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282613 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282750 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282820 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282897 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.282972 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283041 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283108 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283183 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283250 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283325 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283393 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283460 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283533 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283631 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.283934 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.284044 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.284253 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.284362 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.284600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.284705 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.284929 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.285015 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.285256 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.285334 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.285571 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.285648 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.285905 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.285999 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.286223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.286302 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.286542 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.286629 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.286857 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.287056 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.287205 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.287370 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.287578 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.287699 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.287875 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.288016 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.288147 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.288327 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.288464 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.288657 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.288943 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.289035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.289113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.289261 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.289391 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.289580 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.289705 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.290210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.290365 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.290521 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.290665 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.290833 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.291022 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.291195 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.291499 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.291651 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.291792 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.291944 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.292087 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.292237 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.292379 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.292528 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.292679 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.292830 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.292991 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.293136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.293276 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.293427 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.293630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.293775 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.293954 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.294120 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.294264 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.294405 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.294405 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.294695 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.294844 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.295001 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.295153 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.295303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.295458 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.295607 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.295749 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.295891 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.296784 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.296950 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.297104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.297248 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.297451 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.297609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.297751 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.297920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.298069 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.298222 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.298435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.298583 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.298725 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.298891 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.299189 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.299339 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.299482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.299630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.299783 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.299935 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.300188 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.300349 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.300503 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.300646 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.300795 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.300947 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.301089 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.301246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.301389 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.301704 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.301864 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.302097 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.302321 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.302466 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.302619 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.302761 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.302916 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.303066 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.303216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.303370 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.303520 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.303670 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.303822 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.303965 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.304124 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.304274 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.304416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.304564 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.304725 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.304902 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.305056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.305198 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.305345 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.305501 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.305645 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.305794 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.305984 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.306396 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.306659 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.306819 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.307042 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.307186 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.307336 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.307478 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.307627 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.307778 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.307921 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.308070 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.308212 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.308352 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.308352 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.308648 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.308798 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.308940 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.309106 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.309635 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.309785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.309970 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.310138 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.310378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.310535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.310685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.310848 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.311000 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.311141 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.311282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.311429 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.311574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.311897 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.312054 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.312204 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.312354 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.312554 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.312815 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.312971 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.313133 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.313283 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.313426 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.313568 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.313718 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.313892 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.314183 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.314401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.314401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.314692 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.314877 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.315037 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.315188 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.315395 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.315601 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.315792 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.315996 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.316196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.316401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.316589 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.316941 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.317130 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.317284 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.317435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.317576 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.317576 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.317576 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.318035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.318191 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.318191 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.318191 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.318666 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.318819 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.318969 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.319111 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.319252 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.319555 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.319757 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.319974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.320286 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.320581 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.320787 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.321014 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.321188 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.321331 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.321489 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.321638 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.321780 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.322110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.322110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.322110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.322623 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.322777 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.322928 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.323071 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.323071 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.323346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.323499 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.323667 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.323851 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.324060 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.324269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.324483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.324683 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.325014 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.325192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.325334 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.325482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.325634 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.325782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.326052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.326216 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.326359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.326578 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.326578 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.326866 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.327129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.327129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.327129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.327920 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.328340 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.328546 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.328737 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.329081 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.329253 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.329481 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.329749 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.329918 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.330076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.330219 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.330372 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.330545 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.330761 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.330917 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.331059 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.331215 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.331362 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.331362 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.331362 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.331868 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.332181 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.332347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.332519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.332683 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.332840 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.332998 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.333153 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.333309 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.333467 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.333615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.333990 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.334153 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.334303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.334458 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.334616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.334789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.334938 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.335087 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.335242 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.335398 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.335561 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.335751 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.335904 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.336052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.336209 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.336364 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.336527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.336684 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.336851 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.337007 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.337341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.337518 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.337725 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.337990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.338223 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.338374 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.338530 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.338729 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.338882 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.339030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.339178 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.339339 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.339495 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.339643 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.339887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.339887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.340195 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.340354 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.340510 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.340665 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.340901 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.341063 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.341063 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.341381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.341530 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.341685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.341841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.342014 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.342317 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.342482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.342631 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.342779 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.343506 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.343731 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.343889 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.344038 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.344204 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.344361 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.344510 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.344676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.344824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.344981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.345137 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.345286 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.345433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.345590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.345739 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.345922 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.346154 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.346460 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.346628 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.346787 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.346944 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.347093 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.347240 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.347506 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.347663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.347825 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.347992 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.348226 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.348394 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.348562 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.348720 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.348868 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.349033 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.349191 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.349353 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.349502 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.349650 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.349798 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.350054 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.350216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.350373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.350529 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.350776 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.351019 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.351182 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.351415 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.351574 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.351724 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.351873 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.352031 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.352180 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.352483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.352645 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.352802 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.353057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.353219 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.353375 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.353532 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.353681 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.353837 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.354073 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.354238 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.354403 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.357044 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.357226 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.357392 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.357667 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.357667 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.358017 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.358197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.358432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.358653 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.359312 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.359473 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.359641 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.359791 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.359939 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.360182 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.360346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.360502 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.360685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.360844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.361012 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.361234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.361388 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.361544 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.361702 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.361858 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.362048 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.362808 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.363003 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.363173 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.363332 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.363492 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.363641 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.363788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.363935 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.364096 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.364252 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.364411 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.364559 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.364790 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.364943 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.365106 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.365256 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.365413 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.365573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.365722 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.365887 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.366057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.366207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.366362 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.366512 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.366667 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.366826 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.366974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.367129 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.367277 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.367424 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.367591 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.367860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.368016 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.368172 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.368321 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.368553 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.368715 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.368873 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.369022 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.369183 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.369332 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.369545 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.369758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.369968 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.370124 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.370367 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.370520 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.370668 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.370825 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.370981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.371137 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.371372 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.371532 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.371683 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.371844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.372005 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.372153 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.372309 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.372456 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.372622 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.372925 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.373083 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.373240 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.373397 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.373546 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.373694 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.373694 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.374024 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.374206 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.374360 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.374516 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.374685 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.374835 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.374983 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.375129 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.375283 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.375431 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.375587 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.375743 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.375892 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.376039 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.376197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.376345 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.376505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.376661 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.376810 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.376958 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.377112 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.377112 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.377416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.377564 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.377719 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.377903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.378152 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.378334 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.378499 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.378744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.378898 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.379046 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.379202 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.379365 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.379597 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.379747 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.379904 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.380059 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.380210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.380384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.380615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.380767 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.380930 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.381078 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.381287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.381534 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.381699 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.381856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.382067 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.382217 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.382377 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.382542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.382710 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.383004 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.383155 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.383312 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.383471 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.383620 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.383767 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.383915 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.384071 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.384220 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.384378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.384527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.384675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.384841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.384997 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.385153 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.385312 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.385469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.385619 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.385619 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.385916 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.386071 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.386302 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.386454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.386609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.386766 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.386933 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.387092 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.387241 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.387388 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.387537 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.387693 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.387841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.388009 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.388190 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.388446 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.388609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.388858 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.389021 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.389190 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.389339 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.389560 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.389720 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.389941 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.390107 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.390271 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.390419 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.390590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.390824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.390985 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.391147 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.391307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.391464 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.391702 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.391856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.392013 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.392169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.392317 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.392465 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.392611 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.392759 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.393063 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.393229 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.393378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.393537 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.393738 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.393910 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.394074 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.394237 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.394237 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.394518 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.394665 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.394821 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.394983 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.395210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.395362 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.395509 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.395674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.395832 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.395990 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.396139 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.396286 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.396435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.396582 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.396729 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.396886 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.397035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.397035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.397334 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.397502 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.397658 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.397816 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.398018 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.398172 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.398320 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.398494 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.398754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.399002 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.399159 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.399314 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.399471 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.399619 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.399791 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.399791 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.400089 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.400246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.400403 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.400561 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.400719 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.400952 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.401116 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.401272 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.401421 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.401576 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.401741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.402003 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.402169 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.402326 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.402573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.402738 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.402888 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.403184 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.403350 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.403508 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.403670 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.403827 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.403976 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.404131 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.404308 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.404467 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.404617 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.404772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.404960 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.405113 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.405270 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.406015 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.406186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.406345 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.406757 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.406906 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.407085 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.407243 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.407401 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.407557 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.407713 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.407862 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.408010 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.408173 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.408173 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.408482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.408629 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.408795 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.408795 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.409273 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.409432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.409581 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.409742 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.409911 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.410141 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.410570 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.410734 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.410885 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.411120 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.411283 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.411453 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.412410 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.412585 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.412735 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.412884 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.413031 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.413347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.413513 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.413664 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.413827 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.414095 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.414261 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.414411 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.414558 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.414726 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.414875 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.415024 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.415234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.415389 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.415544 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.415544 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.415827 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.415975 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.416132 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.416281 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.416438 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.416587 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.416751 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.416903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.417065 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.417226 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.417383 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.417538 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.417687 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.417843 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.418172 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.418339 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.418488 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.418645 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.418801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.418975 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.419329 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.419496 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.419652 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.419810 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.419967 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.420126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.420276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.420437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.420585 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.420745 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.420984 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.421326 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.422125 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.422278 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.422573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.422742 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.422901 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.423061 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.423211 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.423521 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.423685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.423835 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.424002 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.424153 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.424326 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.424475 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.424623 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.424771 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.424928 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.424928 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.425220 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.425369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.425517 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.425665 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.425828 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.426011 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.426011 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.426321 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.426484 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.426643 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.426800 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.426957 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.427106 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.427267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.427439 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.427703 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.427857 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.428006 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.428154 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.428304 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.428464 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.428626 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.428783 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.428932 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.429087 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.429252 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.429646 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.429806 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.429992 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.430143 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.430291 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.430440 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.430618 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.430774 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.430923 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.431071 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.431249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.431477 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.431640 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.431799 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.431948 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.432161 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.432344 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.433282 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.433474 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.433775 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.433981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.434135 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.434296 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.434456 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.434607 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.434764 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.434914 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.435062 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.435211 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.435372 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.435372 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.435675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.435875 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.436037 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.436196 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.436345 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.436493 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.436642 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.436820 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.436970 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.437126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.437285 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.437434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.437593 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.437742 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.437918 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.438099 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.438266 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.438417 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.438574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.438750 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.439233 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.439394 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.440075 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.440251 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.440419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.440837 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.441001 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.441001 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.441285 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.441451 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.441686 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.441843 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.442037 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.442758 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.442915 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.443106 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.443275 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.443527 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.443846 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.444015 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.445413 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.445599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.445754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.446032 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.446193 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.446354 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.446505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.446740 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.446898 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.447075 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.447227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.447384 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.447534 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.447683 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.447840 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.447990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.448138 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.448295 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.448445 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.448593 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.448751 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.448926 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.449076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.449225 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.449382 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.449549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.449799 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.450079 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.450343 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.450507 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.450657 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.450820 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.450969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.451117 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.451117 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.451430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.451430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.451814 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.451978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.452129 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.452286 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.452740 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.452902 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.453118 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.453277 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.453436 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.453705 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.454044 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.454223 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.454384 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.454536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.454685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.454848 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.454998 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.455161 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.455161 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.455605 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.455765 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.455924 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.456085 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.456243 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.456393 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.456548 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.456706 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.456856 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.457005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.457167 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.457316 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.457465 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.457621 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.457790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.457973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.458214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.458374 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.458374 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.458656 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.458807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.458964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.459114 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.459270 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.459270 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.459270 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.459270 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.459270 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.459980 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.460228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.460228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.460228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.460228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.460228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.460228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.461197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.461347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.461347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.461347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.461347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.461347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.462193 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.462359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.462518 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.462676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.462834 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.462994 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.463143 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.463300 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.463456 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.463615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.463615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.464014 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.464305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.464305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.464305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.464305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.464305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.465023 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.465171 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.465319 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.465467 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.465624 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.465781 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.465947 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.466103 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.466103 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.466420 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.466578 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.466776 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.466931 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.467080 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.467228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.467384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.467534 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.467695 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.467845 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.467845 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.468682 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.468846 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.469006 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.469155 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.469305 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.469461 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.469623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.469783 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.469968 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.470124 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.470366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.470543 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.470803 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.470803 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.471228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.471401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.471560 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.471717 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.471875 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.472043 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.472043 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.472410 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.472567 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.472718 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.472880 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.473039 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.473188 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.473355 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.473513 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.473676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.473853 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.474091 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.474388 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.474546 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.474707 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.474866 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.474866 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.475148 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.475305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.475474 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.475635 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.475795 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.475946 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.476095 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.476251 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.476400 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.476565 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.476723 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.476881 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.477038 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.477188 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.477336 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.477510 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.477661 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.477809 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.478004 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.478155 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.478317 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.478482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.478632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.478788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.478937 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.479096 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.479246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.479415 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.479564 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.479714 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.479879 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.480037 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.480194 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.480362 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.480582 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.480737 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.480997 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.481155 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.481322 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.481473 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.481643 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.481802 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.482028 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.482190 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.482433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.482590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.482748 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.482898 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.483045 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.483207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.483375 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.483534 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.484266 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.484611 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.484768 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.484928 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.485191 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.485353 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.485504 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.485662 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.485820 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.486017 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.486017 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.486303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.486471 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.486756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.486982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.487157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.487316 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.487523 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.487692 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.487844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.488009 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.488166 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.488316 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.488474 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.488638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.488800 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.488963 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.489114 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.489271 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.489422 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.489571 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.489809 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.489809 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.490176 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.490327 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.490476 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.490727 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.490898 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.491794 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.491964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.492116 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.492266 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.492442 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.492697 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.492852 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.493001 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.493150 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.493299 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.493457 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.493618 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.493833 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.494007 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.494157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.494387 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.494804 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.494964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.495113 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.495270 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.495428 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.495585 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.495744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.495908 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.496067 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.496230 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.496404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.496564 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.496723 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.496873 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.497021 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.497178 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.497178 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.497470 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.497621 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.497776 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.497941 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.498117 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.498859 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.499017 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.499167 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.499354 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.499513 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.499678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.499830 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.500039 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.500197 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.500354 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.500643 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.500994 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.501157 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.501318 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.501470 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.501630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.501811 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.502304 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.502462 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.502613 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.502884 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503049 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503222 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503364 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503515 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 20:25:32.503982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 20:25:32.503982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 20:25:32.507228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_db.sqlalchemy.engines [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:25:32.510272 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_db.sqlalchemy.engines [None req-af317e87-4f45-43fd-b289-f09413169075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:25:32.574607 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.context [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87872759-4d17-418e-b91c-df15c67a4efe(cell1) {{(pid=116275) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 20:25:32.578707 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.context [None req-af317e87-4f45-43fd-b289-f09413169075 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87872759-4d17-418e-b91c-df15c67a4efe(cell1) {{(pid=116276) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 20:25:32.579600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:25:32.581216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:25:32.582202 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:25:32.583430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-af317e87-4f45-43fd-b289-f09413169075 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:25:32.584319 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:25:32.585212 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-af317e87-4f45-43fd-b289-f09413169075 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:25:32.586122 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-af317e87-4f45-43fd-b289-f09413169075 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:25:32.588314 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-af317e87-4f45-43fd-b289-f09413169075 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:25:32.595434 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_db.sqlalchemy.engines [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:25:32.597441 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_db.sqlalchemy.engines [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:25:32.600536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_db.sqlalchemy.engines [None req-af317e87-4f45-43fd-b289-f09413169075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:25:32.601996 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_db.sqlalchemy.engines [None req-af317e87-4f45-43fd-b289-f09413169075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:25:32.762234 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_db.sqlalchemy.engines [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:25:32.763752 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_db.sqlalchemy.engines [None req-af317e87-4f45-43fd-b289-f09413169075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 20:25:33.085973 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: WARNING keystonemiddleware.auth_token [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 20:25:33.093651 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: WARNING keystonemiddleware.auth_token [None req-af317e87-4f45-43fd-b289-f09413169075 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 20:25:33.094723 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: WARNING keystonemiddleware.auth_token [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 20:25:33.100789 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: WARNING keystonemiddleware.auth_token [None req-af317e87-4f45-43fd-b289-f09413169075 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 20:25:33.445446 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: WARNING keystonemiddleware.auth_token [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 20:25:33.451928 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: WARNING keystonemiddleware.auth_token [None req-fb198c1e-2d61-48c2-92d8-246ae9e77543 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 20:25:33.458253 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55672e0c09c0 pid: 116275 (default app) Jan 28 20:25:33.481911 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: WARNING keystonemiddleware.auth_token [None req-af317e87-4f45-43fd-b289-f09413169075 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 20:25:33.487145 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: WARNING keystonemiddleware.auth_token [None req-af317e87-4f45-43fd-b289-f09413169075 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 20:25:33.492515 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55672e0c09c0 pid: 116276 (default app) Jan 28 20:26:07.886529 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4937ce14-a674-465a-a611-feaef092cb93 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Action: 'create', calling method: .version_select at 0x7fc77b51dc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1697381798"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:07.990388 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-755dfd22-0e1e-452c-a663-5f0a19b80c4e tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] Action: 'create', calling method: .version_select at 0x7fc77b51cca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-981425266", "metadata": {"Type": "work"}}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:10.094645 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-755dfd22-0e1e-452c-a663-5f0a19b80c4e tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.973479 Jan 28 20:26:10.096409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Fri Jan 28 20:26:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2978 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 28 20:26:10.110144 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3b1c8d5a-9e9e-4684-91b0-c0075556f21b tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] Calling method '.version_select at 0x7fc77b3e8820>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:10.227223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4937ce14-a674-465a-a611-feaef092cb93 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.126258 Jan 28 20:26:10.228536 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 1/2] 10.222.0.59 () {60 vars in 1154 bytes} [Fri Jan 28 20:26:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3129 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 20:26:10.242057 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5418730d-a76f-4e1d-abb8-c910b4040254 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77b3e9790>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:10.351795 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3b1c8d5a-9e9e-4684-91b0-c0075556f21b tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd" status: 200 len: 352 microversion: 2.1 time: 0.247449 Jan 28 20:26:10.353043 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:10 2022] GET /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd => generated 352 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:10.428176 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5418730d-a76f-4e1d-abb8-c910b4040254 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4" status: 200 len: 345 microversion: 2.1 time: 0.191139 Jan 28 20:26:10.429540 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:10 2022] GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4 => generated 345 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:26:10.600974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-935283681", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "networks": [{"uuid": "f7cd137c-ce2e-4c82-9033-a14c7af1ce8b"}]}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:10.796746 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] validate_networks() for [('f7cd137c-ce2e-4c82-9033-a14c7af1ce8b', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:26:11.367908 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-952a40c4-0853-4d6a-9d1b-d635c6abc3ea tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] Calling method '.version_select at 0x7fc77b3e9dc0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:11.442810 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-952a40c4-0853-4d6a-9d1b-d635c6abc3ea tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd" status: 200 len: 353 microversion: 2.1 time: 0.078497 Jan 28 20:26:11.443529 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 3/5] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:11 2022] GET /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:26:11.451297 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-38096c62-2b66-4cd5-a916-c56da8517683 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77b379160>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:11.547822 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-38096c62-2b66-4cd5-a916-c56da8517683 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4" status: 200 len: 345 microversion: 2.1 time: 0.103199 Jan 28 20:26:11.548926 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 4/6] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:11 2022] GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4 => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:11.554523 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9713db63-5e07-4c70-b8d9-d54b84d4993f tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] Calling method '.version_select at 0x7fc77b379a60>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:11.666292 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9713db63-5e07-4c70-b8d9-d54b84d4993f tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd" status: 200 len: 353 microversion: 2.1 time: 0.115377 Jan 28 20:26:11.667443 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 5/7] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:11 2022] GET /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:11.761509 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1572778791", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "networks": [{"uuid": "32455a2f-afe8-40db-a68b-0a5114a70c1b"}]}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:11.877037 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] validate_networks() for [('32455a2f-afe8-40db-a68b-0a5114a70c1b', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:26:12.132461 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:26:12.133038 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:26:12.133654 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:26:12.134324 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:26:12.135210 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:26:12.169281 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:12.169676 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:12.170723 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:12.171162 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:12.246041 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Getting quotas for project d73cfa908e094fa0b8fbc1e550e29d20. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:26:12.266644 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Getting quotas for user 588b4e7353d2411ca853605fa586c8e8 and project d73cfa908e094fa0b8fbc1e550e29d20. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:26:12.293086 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:26:12.301510 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:26:12.493100 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3ff11645-0c2f-4782-b482-9256acf11347 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.138667 Jan 28 20:26:12.494157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 3/8] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:26:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:26:12.501180 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8c43a499-9deb-4570-8173-a6a51823a4ec tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] Calling method '.version_select at 0x7fc77aa910d0>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:12.671280 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8c43a499-9deb-4570-8173-a6a51823a4ec tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd" status: 202 len: 0 microversion: 2.1 time: 0.173467 Jan 28 20:26:12.672484 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 4/9] 10.222.0.59 () {58 vars in 1247 bytes} [Fri Jan 28 20:26:12 2022] DELETE /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:26:12.680299 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a624d6a9-721b-4f6d-9ba5-bdb4aeec7e32 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:12.681234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a624d6a9-721b-4f6d-9ba5-bdb4aeec7e32 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:12.914232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a624d6a9-721b-4f6d-9ba5-bdb4aeec7e32 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:12.934881 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a624d6a9-721b-4f6d-9ba5-bdb4aeec7e32 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1217 microversion: 2.1 time: 0.259438 Jan 28 20:26:12.939213 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 5/10] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:12 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:12.945265 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:26:12.946379 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:26:12.946848 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:26:12.947744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:26:12.948338 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:26:12.953125 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c0451023-f62d-49a9-b95d-aa3d6519b744 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77aaa9940>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:12.968466 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:12.968913 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:12.969863 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:12.970580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:13.013206 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Getting quotas for project 97c5f9b9efd145cca6f89a538c9f0cad. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:26:13.031336 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Getting quotas for user 43a5b794b20746febe0b56190b514595 and project 97c5f9b9efd145cca6f89a538c9f0cad. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:26:13.041674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c0451023-f62d-49a9-b95d-aa3d6519b744 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4" status: 200 len: 346 microversion: 2.1 time: 0.100800 Jan 28 20:26:13.048380 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 6/11] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:12 2022] GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4 => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:13.048380 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7b8c1ff0-53c1-4438-a53c-486867776432 tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] Calling method '.version_select at 0x7fc77a234b80>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:13.060145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:26:13.065690 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:26:13.124710 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-7b8c1ff0-53c1-4438-a53c-486867776432 tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] HTTP exception thrown: Volume 5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd could not be found. Jan 28 20:26:13.126809 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7b8c1ff0-53c1-4438-a53c-486867776432 tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] Returning 404 to user: Volume 5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:13.128482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7b8c1ff0-53c1-4438-a53c-486867776432 tempest-VolumesGetTestJSON-1265097769 tempest-VolumesGetTestJSON-1265097769-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd" status: 404 len: 109 microversion: 2.1 time: 0.084355 Jan 28 20:26:13.129341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 7/12] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:13 2022] GET /compute/v2.1/os-volumes/5a54b4fe-0945-4e7e-84ad-d3e3b653f5cd => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:26:13.146184 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-6df5ff02-93b4-472d-8ddb-bd16e9aeb572 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Action: 'create', calling method: .version_select at 0x7fc77a234790>, body: {"snapshot": {"volume_id": "35d3aaef-5c04-4639-bbdf-7924dd0987d4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1410346092"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:13.267745 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-71307ba3-d82d-40af-a7a0-74216a6eff4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.598287 Jan 28 20:26:13.276975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 6/13] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:26:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:26:13.289151 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a667113f-ea43-42b7-865f-623b5cc312b5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:13.294042 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a667113f-ea43-42b7-865f-623b5cc312b5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:13.588216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a667113f-ea43-42b7-865f-623b5cc312b5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:13.627965 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a667113f-ea43-42b7-865f-623b5cc312b5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1215 microversion: 2.1 time: 0.349430 Jan 28 20:26:13.639188 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 7/14] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:13 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1215 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:13.957512 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-381d7721-2589-47e3-862d-f12338fca640 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:13.958175 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-381d7721-2589-47e3-862d-f12338fca640 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:14.029081 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-6df5ff02-93b4-472d-8ddb-bd16e9aeb572 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.898402 Jan 28 20:26:14.029761 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 8/15] 10.222.0.59 () {60 vars in 1161 bytes} [Fri Jan 28 20:26:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:14.047467 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-be3f3d1c-1cdd-41da-9ab9-c5746090fb7c tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a234dc0>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:14.096163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-be3f3d1c-1cdd-41da-9ab9-c5746090fb7c tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.060209 Jan 28 20:26:14.101443 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 9/16] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:14 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:14.110160 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f66c7c0e-ccf5-47eb-a215-35a6d7f0da44 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77aaa9940>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:14.168744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-381d7721-2589-47e3-862d-f12338fca640 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:14.180800 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-381d7721-2589-47e3-862d-f12338fca640 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1217 microversion: 2.1 time: 0.229773 Jan 28 20:26:14.185009 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 8/17] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:13 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1217 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:14.218602 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f66c7c0e-ccf5-47eb-a215-35a6d7f0da44 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.111967 Jan 28 20:26:14.219718 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 10/18] 10.222.0.59 () {58 vars in 1139 bytes} [Fri Jan 28 20:26:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:14.231063 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8062516b-ca96-47eb-9414-401d1f63345d tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a230d30>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:14.284605 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8062516b-ca96-47eb-9414-401d1f63345d tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.058651 Jan 28 20:26:14.285191 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 9/19] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:14 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:14.645202 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cf5fdd5d-6e79-409d-9d73-c42f7853878c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:14.645851 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-cf5fdd5d-6e79-409d-9d73-c42f7853878c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:14.811267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cf5fdd5d-6e79-409d-9d73-c42f7853878c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:14.817952 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-cf5fdd5d-6e79-409d-9d73-c42f7853878c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1215 microversion: 2.1 time: 0.176429 Jan 28 20:26:14.821665 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 11/20] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:14 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:15.201918 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-aef808ba-5c42-43fa-8c7d-5c0bba41bcf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:15.202538 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-aef808ba-5c42-43fa-8c7d-5c0bba41bcf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:15.212871 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aef808ba-5c42-43fa-8c7d-5c0bba41bcf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:15.213326 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aef808ba-5c42-43fa-8c7d-5c0bba41bcf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:15.214157 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aef808ba-5c42-43fa-8c7d-5c0bba41bcf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:15.225896 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aef808ba-5c42-43fa-8c7d-5c0bba41bcf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:15.298215 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bd1b803f-a00b-453c-9aac-16efee90c46c tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77aaa9940>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:15.334593 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bd1b803f-a00b-453c-9aac-16efee90c46c tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.042028 Jan 28 20:26:15.339146 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 12/21] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:15 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:15.736923 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-aef808ba-5c42-43fa-8c7d-5c0bba41bcf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:15.762702 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-aef808ba-5c42-43fa-8c7d-5c0bba41bcf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1213 microversion: 2.1 time: 0.560698 Jan 28 20:26:15.774739 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 10/22] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:15 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1213 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:15.841714 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4c579254-8615-4cf2-81d0-9c414f18fdb2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:15.842884 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4c579254-8615-4cf2-81d0-9c414f18fdb2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:15.860045 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4c579254-8615-4cf2-81d0-9c414f18fdb2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:15.861056 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4c579254-8615-4cf2-81d0-9c414f18fdb2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:15.862924 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4c579254-8615-4cf2-81d0-9c414f18fdb2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:15.866441 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4c579254-8615-4cf2-81d0-9c414f18fdb2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:16.186752 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4c579254-8615-4cf2-81d0-9c414f18fdb2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:16.205634 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4c579254-8615-4cf2-81d0-9c414f18fdb2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1219 microversion: 2.1 time: 0.370834 Jan 28 20:26:16.210121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 13/23] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:15 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1219 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:16.351656 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3570a129-67c2-4c15-8af4-20d8967b75cf tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a1bc310>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:16.394679 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3570a129-67c2-4c15-8af4-20d8967b75cf tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.051359 Jan 28 20:26:16.395672 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 11/24] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:16 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:16.781833 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d964ed35-4d2c-4ec0-ae16-5fceee06fceb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:16.782465 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d964ed35-4d2c-4ec0-ae16-5fceee06fceb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:16.791986 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d964ed35-4d2c-4ec0-ae16-5fceee06fceb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:16.792432 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d964ed35-4d2c-4ec0-ae16-5fceee06fceb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:16.793221 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d964ed35-4d2c-4ec0-ae16-5fceee06fceb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:16.793660 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d964ed35-4d2c-4ec0-ae16-5fceee06fceb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:16.940245 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d964ed35-4d2c-4ec0-ae16-5fceee06fceb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:16.950568 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d964ed35-4d2c-4ec0-ae16-5fceee06fceb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1213 microversion: 2.1 time: 0.172923 Jan 28 20:26:16.962730 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 14/25] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:16 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:17.226916 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-23d309fb-68b6-4a33-80f0-d3a626457a6b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:17.227824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-23d309fb-68b6-4a33-80f0-d3a626457a6b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:17.246731 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-23d309fb-68b6-4a33-80f0-d3a626457a6b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:17.248860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-23d309fb-68b6-4a33-80f0-d3a626457a6b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:17.253262 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-23d309fb-68b6-4a33-80f0-d3a626457a6b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:17.253987 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-23d309fb-68b6-4a33-80f0-d3a626457a6b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:17.417693 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-71267863-bf7a-4f5e-a484-539d9f31d421 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a1d99d0>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:17.471891 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-23d309fb-68b6-4a33-80f0-d3a626457a6b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:17.486220 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-23d309fb-68b6-4a33-80f0-d3a626457a6b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1219 microversion: 2.1 time: 0.259464 Jan 28 20:26:17.489416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 12/26] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:17 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1219 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:17.497068 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-71267863-bf7a-4f5e-a484-539d9f31d421 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.094238 Jan 28 20:26:17.497739 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 15/27] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:17 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:17.984776 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9bb6db06-adc4-44c6-91c0-b00ac12fa659 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:17.986828 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9bb6db06-adc4-44c6-91c0-b00ac12fa659 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:17.996661 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9bb6db06-adc4-44c6-91c0-b00ac12fa659 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:17.997303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9bb6db06-adc4-44c6-91c0-b00ac12fa659 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:18.000378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9bb6db06-adc4-44c6-91c0-b00ac12fa659 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:18.000984 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9bb6db06-adc4-44c6-91c0-b00ac12fa659 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:18.078678 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ac8d3ca4-8977-4297-8fec-78b0d3ddab22 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Action: 'create', calling method: .version_select at 0x7fc77b38eaf0>, body: {"keypair": {"name": "tempest-keypair-1597116798"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:18.111167 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-ac8d3ca4-8977-4297-8fec-78b0d3ddab22 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for project 51269d658f0540dab6086a21ebd9e00f. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:26:18.116919 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-ac8d3ca4-8977-4297-8fec-78b0d3ddab22 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for user a80b14067e3245c49fbbde4ca5f0bf76 and project 51269d658f0540dab6086a21ebd9e00f. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:26:18.307073 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9bb6db06-adc4-44c6-91c0-b00ac12fa659 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:18.315731 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9bb6db06-adc4-44c6-91c0-b00ac12fa659 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1213 microversion: 2.1 time: 0.339528 Jan 28 20:26:18.321340 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 16/28] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:17 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1213 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:18.325286 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-ac8d3ca4-8977-4297-8fec-78b0d3ddab22 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for project 51269d658f0540dab6086a21ebd9e00f. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:26:18.329504 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-ac8d3ca4-8977-4297-8fec-78b0d3ddab22 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for user a80b14067e3245c49fbbde4ca5f0bf76 and project 51269d658f0540dab6086a21ebd9e00f. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:26:18.344572 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ac8d3ca4-8977-4297-8fec-78b0d3ddab22 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.647796 Jan 28 20:26:18.351458 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 13/29] 10.222.0.59 () {62 vars in 1198 bytes} [Fri Jan 28 20:26:17 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 655 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 28 20:26:18.509324 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-06830f5c-42db-446f-a9a8-554474059571 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a1bc040>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:18.512754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ed9b9f5c-0d78-48f2-ae29-1d7625d1216f tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:18.513390 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ed9b9f5c-0d78-48f2-ae29-1d7625d1216f tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:18.538198 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed9b9f5c-0d78-48f2-ae29-1d7625d1216f tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:18.542890 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed9b9f5c-0d78-48f2-ae29-1d7625d1216f tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:18.546304 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed9b9f5c-0d78-48f2-ae29-1d7625d1216f tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:18.552226 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-06830f5c-42db-446f-a9a8-554474059571 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.047677 Jan 28 20:26:18.553704 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 14/30] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:18 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:18.556646 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed9b9f5c-0d78-48f2-ae29-1d7625d1216f tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:18.876167 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ed9b9f5c-0d78-48f2-ae29-1d7625d1216f tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:18.887512 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ed9b9f5c-0d78-48f2-ae29-1d7625d1216f tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1219 microversion: 2.1 time: 0.383662 Jan 28 20:26:18.900313 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 17/31] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:18 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1219 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:19.070928 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-610717529", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:19.161953 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] validate_networks() for [('985d3604-0360-4ae4-846c-94a6045e656d', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:26:19.336437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-766a58bf-1254-4850-aac9-6c02783d9c46 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:19.337121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-766a58bf-1254-4850-aac9-6c02783d9c46 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:19.347139 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-766a58bf-1254-4850-aac9-6c02783d9c46 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:19.347631 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-766a58bf-1254-4850-aac9-6c02783d9c46 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:19.349868 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-766a58bf-1254-4850-aac9-6c02783d9c46 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:19.350343 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-766a58bf-1254-4850-aac9-6c02783d9c46 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:19.539235 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-766a58bf-1254-4850-aac9-6c02783d9c46 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:19.554806 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-766a58bf-1254-4850-aac9-6c02783d9c46 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1213 microversion: 2.1 time: 0.221763 Jan 28 20:26:19.561002 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 18/32] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:19 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1213 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:19.577466 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-dab115bd-f165-4629-90fd-10d99de2586d tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77bd061f0>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:19.675499 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-dab115bd-f165-4629-90fd-10d99de2586d tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.111536 Jan 28 20:26:19.676285 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 19/33] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:19 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:19.908409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-128310df-19ac-4642-a144-ca2af5ec68c1 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:19.909121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-128310df-19ac-4642-a144-ca2af5ec68c1 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:19.922202 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-128310df-19ac-4642-a144-ca2af5ec68c1 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:19.927421 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-128310df-19ac-4642-a144-ca2af5ec68c1 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:19.929026 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-128310df-19ac-4642-a144-ca2af5ec68c1 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:19.929654 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-128310df-19ac-4642-a144-ca2af5ec68c1 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:20.158594 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-128310df-19ac-4642-a144-ca2af5ec68c1 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:20.168645 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-128310df-19ac-4642-a144-ca2af5ec68c1 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1219 microversion: 2.1 time: 0.264549 Jan 28 20:26:20.170884 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 20/34] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:19 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1219 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:20.228328 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:26:20.231142 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:26:20.231790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:26:20.234539 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:26:20.235107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:26:20.246391 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:20.247002 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:20.248612 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:20.249181 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:20.270576 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Getting quotas for project d0f6f9108399481680b96ea944fe5387. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:26:20.275744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Getting quotas for user 545d8edb84904f639777764fca8f7b4d and project d0f6f9108399481680b96ea944fe5387. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:26:20.290802 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:26:20.293713 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:26:20.397043 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-22e4b6b2-4e77-490a-9374-1c8f6276b4f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.676338 Jan 28 20:26:20.402629 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 15/35] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:26:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 20:26:20.408792 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-420be4a5-c344-42d2-9a0d-b77b3d77f244 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:20.409558 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-420be4a5-c344-42d2-9a0d-b77b3d77f244 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:20.552535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-420be4a5-c344-42d2-9a0d-b77b3d77f244 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:20.562836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-420be4a5-c344-42d2-9a0d-b77b3d77f244 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1221 microversion: 2.1 time: 0.158518 Jan 28 20:26:20.569966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 21/36] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:20 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:20.576378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e2db2c4e-a682-4d9f-bf0f-1d7067cd642b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:20.577346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e2db2c4e-a682-4d9f-bf0f-1d7067cd642b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:20.586831 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e2db2c4e-a682-4d9f-bf0f-1d7067cd642b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:20.587884 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e2db2c4e-a682-4d9f-bf0f-1d7067cd642b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:20.588879 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e2db2c4e-a682-4d9f-bf0f-1d7067cd642b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:20.589432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e2db2c4e-a682-4d9f-bf0f-1d7067cd642b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:20.687274 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e102a203-9eec-4cc6-8e53-a5b0d74e0698 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a17b0d0>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:20.709309 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e2db2c4e-a682-4d9f-bf0f-1d7067cd642b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:20.750777 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e2db2c4e-a682-4d9f-bf0f-1d7067cd642b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1269 microversion: 2.1 time: 0.175969 Jan 28 20:26:20.756073 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 16/37] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:20 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:20.798240 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e102a203-9eec-4cc6-8e53-a5b0d74e0698 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 288 microversion: 2.1 time: 0.114119 Jan 28 20:26:20.799075 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 22/38] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:20 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 288 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:26:20.813482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-693a7cac-dee4-4924-98f8-9623bc1900db tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc779935dc0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:21.013079 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-100298014", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:21.037076 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-693a7cac-dee4-4924-98f8-9623bc1900db tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 202 len: 0 microversion: 2.1 time: 0.230220 Jan 28 20:26:21.037945 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 17/39] 10.222.0.59 () {58 vars in 1253 bytes} [Fri Jan 28 20:26:20 2022] DELETE /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:26:21.047675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b2f1e58c-d7aa-49d0-894a-60f160cb5dee tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc7799321f0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:21.110103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] validate_networks() for [('985d3604-0360-4ae4-846c-94a6045e656d', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:26:21.173451 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b2f1e58c-d7aa-49d0-894a-60f160cb5dee tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.130884 Jan 28 20:26:21.174476 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 18/40] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:21 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:21.187482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-90584026-c9fa-4d74-9469-725a4f4caf54 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:21.188693 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-90584026-c9fa-4d74-9469-725a4f4caf54 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:21.204592 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90584026-c9fa-4d74-9469-725a4f4caf54 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:21.211153 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90584026-c9fa-4d74-9469-725a4f4caf54 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:21.212337 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90584026-c9fa-4d74-9469-725a4f4caf54 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:21.216790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90584026-c9fa-4d74-9469-725a4f4caf54 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:21.483477 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-90584026-c9fa-4d74-9469-725a4f4caf54 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:21.494083 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-90584026-c9fa-4d74-9469-725a4f4caf54 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1211 microversion: 2.1 time: 0.312000 Jan 28 20:26:21.503107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 19/41] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:21 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1211 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:21.768955 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-68398dc7-3cd9-42fb-9c67-c6fcae739f18 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:21.769638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-68398dc7-3cd9-42fb-9c67-c6fcae739f18 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:21.781087 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68398dc7-3cd9-42fb-9c67-c6fcae739f18 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:21.781587 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68398dc7-3cd9-42fb-9c67-c6fcae739f18 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:21.782430 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68398dc7-3cd9-42fb-9c67-c6fcae739f18 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:21.789057 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68398dc7-3cd9-42fb-9c67-c6fcae739f18 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:21.938200 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-68398dc7-3cd9-42fb-9c67-c6fcae739f18 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:21.953021 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-68398dc7-3cd9-42fb-9c67-c6fcae739f18 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1269 microversion: 2.1 time: 0.187741 Jan 28 20:26:21.953716 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 20/42] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:21 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:22.188149 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ee111b68-d927-48b3-91a4-59034a24bdc2 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77993e4c0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:22.274639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ee111b68-d927-48b3-91a4-59034a24bdc2 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.093004 Jan 28 20:26:22.279578 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 21/43] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:22 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:22.285346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1658340490", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6189d54-a943-4614-aea9-0a741e80c5fa"}], "security_groups": [{"name": "tempest-securitygroup--471163148"}], "key_name": "tempest-keypair-1597116798", "user_data": "}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:22.495143 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] validate_networks() for [('e6189d54-a943-4614-aea9-0a741e80c5fa', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:26:22.551443 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:26:22.551955 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:26:22.552341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:26:22.552754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:26:22.553168 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:26:22.574763 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:22.575332 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:22.576311 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:22.576909 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:22.622276 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Getting quotas for project d0f6f9108399481680b96ea944fe5387. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:26:22.629603 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Getting quotas for user 545d8edb84904f639777764fca8f7b4d and project d0f6f9108399481680b96ea944fe5387. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:26:22.661919 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:26:22.668537 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:26:22.772959 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d1ac7cf4-7d58-432b-a8f2-0ea19f2d2dc6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.764505 Jan 28 20:26:22.774104 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:26:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:26:22.793401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-458d7409-47ed-474b-ae66-3599801bcd09 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:22.794349 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-458d7409-47ed-474b-ae66-3599801bcd09 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:22.803560 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-458d7409-47ed-474b-ae66-3599801bcd09 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:22.804333 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-458d7409-47ed-474b-ae66-3599801bcd09 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:22.805378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-458d7409-47ed-474b-ae66-3599801bcd09 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:22.807824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-458d7409-47ed-474b-ae66-3599801bcd09 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:22.955936 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-458d7409-47ed-474b-ae66-3599801bcd09 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:22.977281 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-458d7409-47ed-474b-ae66-3599801bcd09 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1267 microversion: 2.1 time: 0.193110 Jan 28 20:26:22.988375 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 24/45] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:22 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:22.998974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-80271697-0206-4601-8a62-d95f19ff8634 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:23.000611 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-80271697-0206-4601-8a62-d95f19ff8634 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:23.157687 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-80271697-0206-4601-8a62-d95f19ff8634 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:23.182675 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-80271697-0206-4601-8a62-d95f19ff8634 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1221 microversion: 2.1 time: 0.184167 Jan 28 20:26:23.185390 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 25/46] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:22 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:23.192096 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3a5b5956-681b-4f0d-985b-f68a4751d44f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:23.193210 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3a5b5956-681b-4f0d-985b-f68a4751d44f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:23.211266 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a5b5956-681b-4f0d-985b-f68a4751d44f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:23.212012 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a5b5956-681b-4f0d-985b-f68a4751d44f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:23.214492 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a5b5956-681b-4f0d-985b-f68a4751d44f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:23.215195 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a5b5956-681b-4f0d-985b-f68a4751d44f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:23.296550 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:26:23.296964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:26:23.297862 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:26:23.299296 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:26:23.299870 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:26:23.318812 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:23.319631 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:23.320628 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:23.322554 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:23.357481 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for project 51269d658f0540dab6086a21ebd9e00f. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:26:23.358628 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3a5b5956-681b-4f0d-985b-f68a4751d44f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:23.362053 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for user a80b14067e3245c49fbbde4ca5f0bf76 and project 51269d658f0540dab6086a21ebd9e00f. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:26:23.366626 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3a5b5956-681b-4f0d-985b-f68a4751d44f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1269 microversion: 2.1 time: 0.179439 Jan 28 20:26:23.367407 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 26/47] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:23 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:23.377598 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bf5f0343-8bb7-4339-b410-935d5b430f61 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a1a8550>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:23.389384 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:26:23.391980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:26:23.423406 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bf5f0343-8bb7-4339-b410-935d5b430f61 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.053724 Jan 28 20:26:23.424961 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 27/48] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:23 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:23.462406 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-82112ede-d275-43c9-8354-0193171b3894 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.181129 Jan 28 20:26:23.464136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 22/49] 10.222.0.59 () {62 vars in 1187 bytes} [Fri Jan 28 20:26:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 20:26:23.476246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-45fd004e-c6f2-48d1-a0d9-fb12763484c4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:23.477279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-45fd004e-c6f2-48d1-a0d9-fb12763484c4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:23.570441 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-45fd004e-c6f2-48d1-a0d9-fb12763484c4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:23.582351 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-45fd004e-c6f2-48d1-a0d9-fb12763484c4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:23.585766 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-45fd004e-c6f2-48d1-a0d9-fb12763484c4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:23.587376 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-45fd004e-c6f2-48d1-a0d9-fb12763484c4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1282 microversion: 2.20 time: 0.116591 Jan 28 20:26:23.588621 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 28/50] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:23 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:24.000366 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6cde7455-d1ea-4400-8930-7ca4f2f636f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:24.001018 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6cde7455-d1ea-4400-8930-7ca4f2f636f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:24.018355 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6cde7455-d1ea-4400-8930-7ca4f2f636f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:24.021044 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6cde7455-d1ea-4400-8930-7ca4f2f636f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:24.038880 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6cde7455-d1ea-4400-8930-7ca4f2f636f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:24.040435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6cde7455-d1ea-4400-8930-7ca4f2f636f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:24.201395 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f1f2a87c-2fb5-4865-b8dc-3679b347f8f0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:24.202060 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f1f2a87c-2fb5-4865-b8dc-3679b347f8f0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:24.223140 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f1f2a87c-2fb5-4865-b8dc-3679b347f8f0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:24.223140 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f1f2a87c-2fb5-4865-b8dc-3679b347f8f0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:24.223140 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f1f2a87c-2fb5-4865-b8dc-3679b347f8f0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:24.223140 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f1f2a87c-2fb5-4865-b8dc-3679b347f8f0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:24.296164 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6cde7455-d1ea-4400-8930-7ca4f2f636f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:24.308808 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6cde7455-d1ea-4400-8930-7ca4f2f636f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1267 microversion: 2.1 time: 0.313556 Jan 28 20:26:24.318519 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 23/51] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:23 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:24.384258 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a6dcc403-b60f-4654-9d18-e2450dae3c9e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:24.384961 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a6dcc403-b60f-4654-9d18-e2450dae3c9e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:24.393328 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a6dcc403-b60f-4654-9d18-e2450dae3c9e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:24.394344 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a6dcc403-b60f-4654-9d18-e2450dae3c9e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:24.395295 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a6dcc403-b60f-4654-9d18-e2450dae3c9e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:24.398442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a6dcc403-b60f-4654-9d18-e2450dae3c9e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:24.425787 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f1f2a87c-2fb5-4865-b8dc-3679b347f8f0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:24.438046 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f1f2a87c-2fb5-4865-b8dc-3679b347f8f0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1273 microversion: 2.1 time: 0.239812 Jan 28 20:26:24.450489 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 29/52] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:24 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:24.459378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2b8ad630-a242-4b68-8936-1d4831619c25 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a234ee0>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:24.517849 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2b8ad630-a242-4b68-8936-1d4831619c25 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 200 len: 287 microversion: 2.1 time: 0.063542 Jan 28 20:26:24.519383 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 30/53] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:24 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:24.609781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:24.611817 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:24.626727 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a6dcc403-b60f-4654-9d18-e2450dae3c9e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:24.626953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:24.629569 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:24.631703 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:24.632765 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:24.639099 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a6dcc403-b60f-4654-9d18-e2450dae3c9e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1287 microversion: 2.1 time: 0.257437 Jan 28 20:26:24.639933 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 24/54] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:24 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1287 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:25.173243 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:25.190560 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:25.194923 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:25.197499 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1b54e133-f47a-46ab-89fe-5eac3c53aa3e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1278 microversion: 2.20 time: 0.593037 Jan 28 20:26:25.200811 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 31/55] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:24 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1278 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:25.344495 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-97df4510-5ccd-4a67-8a2c-97d4b9222f23 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:25.345229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-97df4510-5ccd-4a67-8a2c-97d4b9222f23 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:25.358770 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-97df4510-5ccd-4a67-8a2c-97d4b9222f23 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:25.359202 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-97df4510-5ccd-4a67-8a2c-97d4b9222f23 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:25.360006 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-97df4510-5ccd-4a67-8a2c-97d4b9222f23 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:25.360448 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-97df4510-5ccd-4a67-8a2c-97d4b9222f23 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:25.455570 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c5ee89b2-2eec-4fd9-b077-eca3e09977c3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:25.456402 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c5ee89b2-2eec-4fd9-b077-eca3e09977c3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:25.467754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c5ee89b2-2eec-4fd9-b077-eca3e09977c3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:25.468209 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c5ee89b2-2eec-4fd9-b077-eca3e09977c3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:25.481076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c5ee89b2-2eec-4fd9-b077-eca3e09977c3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:25.483022 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c5ee89b2-2eec-4fd9-b077-eca3e09977c3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:25.923771 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-97df4510-5ccd-4a67-8a2c-97d4b9222f23 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:25.935998 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-97df4510-5ccd-4a67-8a2c-97d4b9222f23 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1273 microversion: 2.1 time: 0.599719 Jan 28 20:26:25.937113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 25/56] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:25 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1273 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:25.955479 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-314cf165-48d4-419f-9d2c-e0a87d6a7d3e tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77aaa6940>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:26.010492 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c5ee89b2-2eec-4fd9-b077-eca3e09977c3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:26.021170 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c5ee89b2-2eec-4fd9-b077-eca3e09977c3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1279 microversion: 2.1 time: 0.567505 Jan 28 20:26:26.023993 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 32/57] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:25 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1279 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:26.033343 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-358452a1-1323-4525-992a-bed83f520e83 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:26.036326 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-358452a1-1323-4525-992a-bed83f520e83 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:26.050535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-358452a1-1323-4525-992a-bed83f520e83 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:26.053046 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-358452a1-1323-4525-992a-bed83f520e83 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:26.055690 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-358452a1-1323-4525-992a-bed83f520e83 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:26.057387 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-358452a1-1323-4525-992a-bed83f520e83 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:26.115435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-314cf165-48d4-419f-9d2c-e0a87d6a7d3e tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] HTTP exception thrown: Snapshot 6741f85f-4260-452a-ade4-a3bb9d6c26bc could not be found. Jan 28 20:26:26.116568 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-314cf165-48d4-419f-9d2c-e0a87d6a7d3e tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Returning 404 to user: Snapshot 6741f85f-4260-452a-ade4-a3bb9d6c26bc could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:26.118272 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-314cf165-48d4-419f-9d2c-e0a87d6a7d3e tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc" status: 404 len: 111 microversion: 2.1 time: 0.172945 Jan 28 20:26:26.119377 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 26/58] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:26:25 2022] GET /compute/v2.1/os-snapshots/6741f85f-4260-452a-ade4-a3bb9d6c26bc => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:26:26.129428 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-502db371-04e7-4c13-a7d8-b4de486dba70 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77bd061f0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:26.251410 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-358452a1-1323-4525-992a-bed83f520e83 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:26.259925 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-358452a1-1323-4525-992a-bed83f520e83 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1275 microversion: 2.1 time: 0.236002 Jan 28 20:26:26.274045 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 33/59] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:26 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:26.284650 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:26.287113 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:26.310462 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:26.311165 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:26.312064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:26.312581 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:26.418379 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-502db371-04e7-4c13-a7d8-b4de486dba70 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4" status: 202 len: 0 microversion: 2.1 time: 0.294450 Jan 28 20:26:26.420350 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 27/60] 10.222.0.59 () {58 vars in 1247 bytes} [Fri Jan 28 20:26:26 2022] DELETE /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:26:26.428609 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cf62f0b7-92fe-422a-a87c-a857de3987c6 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77993e550>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:26.526982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:26.537758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:26.548050 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:26.551788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4b5133ff-6845-4481-a576-70a1e3f7a4e7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1340 microversion: 2.20 time: 0.276489 Jan 28 20:26:26.572437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 34/61] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:26 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1340 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:26.604855 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cf62f0b7-92fe-422a-a87c-a857de3987c6 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4" status: 200 len: 345 microversion: 2.1 time: 0.179752 Jan 28 20:26:26.606390 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 28/62] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:26 2022] GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:26:26.954804 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e24c3b30-3a82-4e70-9cc3-132d145bc239 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:26.955481 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e24c3b30-3a82-4e70-9cc3-132d145bc239 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:26.972121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e24c3b30-3a82-4e70-9cc3-132d145bc239 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:26.973220 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e24c3b30-3a82-4e70-9cc3-132d145bc239 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:26.975762 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e24c3b30-3a82-4e70-9cc3-132d145bc239 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:26.978807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e24c3b30-3a82-4e70-9cc3-132d145bc239 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:27.037318 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2ae19875-2141-40ff-9496-fc23f08cbb48 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:27.038180 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2ae19875-2141-40ff-9496-fc23f08cbb48 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:27.055990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ae19875-2141-40ff-9496-fc23f08cbb48 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:27.056822 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ae19875-2141-40ff-9496-fc23f08cbb48 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:27.061971 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ae19875-2141-40ff-9496-fc23f08cbb48 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:27.069839 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ae19875-2141-40ff-9496-fc23f08cbb48 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:27.247265 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e24c3b30-3a82-4e70-9cc3-132d145bc239 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:27.256353 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e24c3b30-3a82-4e70-9cc3-132d145bc239 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1273 microversion: 2.1 time: 0.305835 Jan 28 20:26:27.264033 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 35/63] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:26 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:27.280671 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-94ba2381-d0b6-4149-bbee-64f944eda293 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:27.281777 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-94ba2381-d0b6-4149-bbee-64f944eda293 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:27.328012 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-94ba2381-d0b6-4149-bbee-64f944eda293 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:27.328508 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-94ba2381-d0b6-4149-bbee-64f944eda293 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:27.330664 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-94ba2381-d0b6-4149-bbee-64f944eda293 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:27.338559 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-94ba2381-d0b6-4149-bbee-64f944eda293 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:27.398223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2ae19875-2141-40ff-9496-fc23f08cbb48 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:27.420249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2ae19875-2141-40ff-9496-fc23f08cbb48 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1279 microversion: 2.1 time: 0.384897 Jan 28 20:26:27.421822 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 29/64] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:27 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1279 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:27.574050 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:27.574658 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:27.590878 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:27.591432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:27.599897 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:27.609473 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:27.954091 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:27.974808 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:27.983956 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:27.984118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-94ba2381-d0b6-4149-bbee-64f944eda293 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:27.993653 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c125e501-dd0b-494f-98cb-26d78f56992a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1340 microversion: 2.20 time: 0.419142 Jan 28 20:26:28.000981 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-94ba2381-d0b6-4149-bbee-64f944eda293 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1275 microversion: 2.1 time: 0.721326 Jan 28 20:26:28.004064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 36/65] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:27 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1275 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:28.012442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 30/66] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:27 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1340 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:28.021494 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-085c2837-69e3-4ba6-884c-3daa44d6f682 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a133550>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:28.059284 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-085c2837-69e3-4ba6-884c-3daa44d6f682 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] HTTP exception thrown: Volume 35d3aaef-5c04-4639-bbdf-7924dd0987d4 could not be found. Jan 28 20:26:28.060583 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-085c2837-69e3-4ba6-884c-3daa44d6f682 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Returning 404 to user: Volume 35d3aaef-5c04-4639-bbdf-7924dd0987d4 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:28.061384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-085c2837-69e3-4ba6-884c-3daa44d6f682 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4" status: 404 len: 109 microversion: 2.1 time: 0.054769 Jan 28 20:26:28.066744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 37/67] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:28 2022] GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:26:28.071448 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-02807ec1-7d4d-4692-aeee-8a0792729434 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc779932430>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:28.116294 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-02807ec1-7d4d-4692-aeee-8a0792729434 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] HTTP exception thrown: Volume 35d3aaef-5c04-4639-bbdf-7924dd0987d4 could not be found. Jan 28 20:26:28.117589 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-02807ec1-7d4d-4692-aeee-8a0792729434 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Returning 404 to user: Volume 35d3aaef-5c04-4639-bbdf-7924dd0987d4 could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:28.119102 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-02807ec1-7d4d-4692-aeee-8a0792729434 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4" status: 404 len: 109 microversion: 2.1 time: 0.051204 Jan 28 20:26:28.120340 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 31/68] 10.222.0.59 () {58 vars in 1247 bytes} [Fri Jan 28 20:26:28 2022] DELETE /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:26:28.137206 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d09f21c1-7067-4f1c-a13a-9b84b3bb59b9 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Calling method '.version_select at 0x7fc77a172c10>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:28.194391 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-d09f21c1-7067-4f1c-a13a-9b84b3bb59b9 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] HTTP exception thrown: Volume 35d3aaef-5c04-4639-bbdf-7924dd0987d4 could not be found. Jan 28 20:26:28.195332 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d09f21c1-7067-4f1c-a13a-9b84b3bb59b9 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] Returning 404 to user: Volume 35d3aaef-5c04-4639-bbdf-7924dd0987d4 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:28.196412 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d09f21c1-7067-4f1c-a13a-9b84b3bb59b9 tempest-VolumesSnapshotsTestJSON-1042386437 tempest-VolumesSnapshotsTestJSON-1042386437-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4" status: 404 len: 109 microversion: 2.1 time: 0.068949 Jan 28 20:26:28.200181 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 38/69] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:28 2022] GET /compute/v2.1/os-volumes/35d3aaef-5c04-4639-bbdf-7924dd0987d4 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:26:28.278748 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b40aa9af-c0da-4457-9054-33f30c1f0a4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:28.279449 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b40aa9af-c0da-4457-9054-33f30c1f0a4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:28.290864 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b40aa9af-c0da-4457-9054-33f30c1f0a4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:28.292362 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b40aa9af-c0da-4457-9054-33f30c1f0a4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:28.295535 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b40aa9af-c0da-4457-9054-33f30c1f0a4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:28.299642 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b40aa9af-c0da-4457-9054-33f30c1f0a4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:28.440169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-187067f6-9336-4359-b7b2-9702e44f888d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:28.441606 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-187067f6-9336-4359-b7b2-9702e44f888d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:28.459788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-187067f6-9336-4359-b7b2-9702e44f888d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:28.462631 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-187067f6-9336-4359-b7b2-9702e44f888d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:28.463767 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-187067f6-9336-4359-b7b2-9702e44f888d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:28.465572 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-187067f6-9336-4359-b7b2-9702e44f888d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:28.549808 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b40aa9af-c0da-4457-9054-33f30c1f0a4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:28.558027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b40aa9af-c0da-4457-9054-33f30c1f0a4b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1273 microversion: 2.1 time: 0.283106 Jan 28 20:26:28.562013 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 32/70] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:28 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:28.675801 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-187067f6-9336-4359-b7b2-9702e44f888d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:28.684385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-187067f6-9336-4359-b7b2-9702e44f888d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1279 microversion: 2.1 time: 0.249840 Jan 28 20:26:28.693401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 39/71] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:28 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:29.024220 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-25fbcea4-ec3c-423f-9820-180f18d57f87 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:29.024846 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:29.026439 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-25fbcea4-ec3c-423f-9820-180f18d57f87 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:29.026942 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:29.051518 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-25fbcea4-ec3c-423f-9820-180f18d57f87 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:29.057587 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-25fbcea4-ec3c-423f-9820-180f18d57f87 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:29.059424 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:29.061051 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:29.063248 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-25fbcea4-ec3c-423f-9820-180f18d57f87 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:29.067017 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:29.072370 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-25fbcea4-ec3c-423f-9820-180f18d57f87 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:29.073736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:29.298796 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:29.319986 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:29.328344 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:29.336985 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c7c4ef9b-b4c3-4f48-8e75-a917bbdc0030 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1340 microversion: 2.20 time: 0.323385 Jan 28 20:26:29.338235 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 33/72] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:29 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1340 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:29.578256 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f24b495b-2438-41a8-ae81-e959db97b591 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:29.578972 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f24b495b-2438-41a8-ae81-e959db97b591 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:29.601535 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f24b495b-2438-41a8-ae81-e959db97b591 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:29.612808 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f24b495b-2438-41a8-ae81-e959db97b591 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:29.616906 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f24b495b-2438-41a8-ae81-e959db97b591 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:29.618491 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f24b495b-2438-41a8-ae81-e959db97b591 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:30.360010 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-25fbcea4-ec3c-423f-9820-180f18d57f87 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:30.383437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-25fbcea4-ec3c-423f-9820-180f18d57f87 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 1.366953 Jan 28 20:26:30.387111 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 40/73] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:29 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:30.393887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2764a344-f59f-4efc-8d1f-dd87cafb4bde tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:30.394880 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2764a344-f59f-4efc-8d1f-dd87cafb4bde tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:30.406424 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2764a344-f59f-4efc-8d1f-dd87cafb4bde tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:30.408066 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2764a344-f59f-4efc-8d1f-dd87cafb4bde tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:30.409057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2764a344-f59f-4efc-8d1f-dd87cafb4bde tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:30.409825 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2764a344-f59f-4efc-8d1f-dd87cafb4bde tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:30.640445 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2764a344-f59f-4efc-8d1f-dd87cafb4bde tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:30.653212 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2764a344-f59f-4efc-8d1f-dd87cafb4bde tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1279 microversion: 2.1 time: 0.264380 Jan 28 20:26:30.655118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 41/74] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:30 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:30.661351 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:30.662374 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:30.663143 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f24b495b-2438-41a8-ae81-e959db97b591 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:30.676467 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f24b495b-2438-41a8-ae81-e959db97b591 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 1.102224 Jan 28 20:26:30.677044 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 34/75] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:29 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:30.680366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:30.681000 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:30.682360 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:30.682934 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:31.402662 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-898e9dc7-8494-410e-8d63-82503904eb04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:31.403209 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-898e9dc7-8494-410e-8d63-82503904eb04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:31.423897 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-898e9dc7-8494-410e-8d63-82503904eb04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:31.427544 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-898e9dc7-8494-410e-8d63-82503904eb04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:31.431034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-898e9dc7-8494-410e-8d63-82503904eb04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:31.431582 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-898e9dc7-8494-410e-8d63-82503904eb04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:31.978388 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:31.997159 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:32.000334 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:32.002173 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bbbf4cbb-b2b0-4442-90af-f12885b5b73b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 1.344883 Jan 28 20:26:32.003877 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 42/76] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:30 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:32.018813 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0779f154-cf04-43d3-94aa-bf22fc3e2ca6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:32.020529 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0779f154-cf04-43d3-94aa-bf22fc3e2ca6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:32.044988 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0779f154-cf04-43d3-94aa-bf22fc3e2ca6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:32.045829 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0779f154-cf04-43d3-94aa-bf22fc3e2ca6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:32.047272 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0779f154-cf04-43d3-94aa-bf22fc3e2ca6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:32.048192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0779f154-cf04-43d3-94aa-bf22fc3e2ca6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:32.471313 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-898e9dc7-8494-410e-8d63-82503904eb04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:32.478488 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-898e9dc7-8494-410e-8d63-82503904eb04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 1.079397 Jan 28 20:26:32.480553 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 35/77] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:31 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:32.497173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d7970cbc-8b97-45b0-86c2-667bb45e2d67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:32.501775 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d7970cbc-8b97-45b0-86c2-667bb45e2d67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:32.523402 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d7970cbc-8b97-45b0-86c2-667bb45e2d67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:32.524907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d7970cbc-8b97-45b0-86c2-667bb45e2d67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:32.529454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d7970cbc-8b97-45b0-86c2-667bb45e2d67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:32.530539 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d7970cbc-8b97-45b0-86c2-667bb45e2d67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:33.046866 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0779f154-cf04-43d3-94aa-bf22fc3e2ca6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:33.055574 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0779f154-cf04-43d3-94aa-bf22fc3e2ca6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 1.050394 Jan 28 20:26:33.056813 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 43/78] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:32 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:33.079725 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:33.081232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:33.089172 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:33.090210 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:33.093538 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:33.096618 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:33.277547 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d7970cbc-8b97-45b0-86c2-667bb45e2d67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:33.290382 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d7970cbc-8b97-45b0-86c2-667bb45e2d67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.807817 Jan 28 20:26:33.306473 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 36/79] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:32 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:33.497271 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d85c5991-4a95-4101-86d0-dc5995196f48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:33.498273 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d85c5991-4a95-4101-86d0-dc5995196f48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:33.511649 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d85c5991-4a95-4101-86d0-dc5995196f48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:33.518779 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d85c5991-4a95-4101-86d0-dc5995196f48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:33.519832 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d85c5991-4a95-4101-86d0-dc5995196f48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:33.526493 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d85c5991-4a95-4101-86d0-dc5995196f48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:33.671841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:33.688604 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:33.690177 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:33.695383 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a64c761f-d65a-4300-9690-23969b2d08a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.622830 Jan 28 20:26:33.701645 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 44/80] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:33 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:34.073080 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-915eeb70-3732-406d-9b29-92e03baa6129 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:34.074772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-915eeb70-3732-406d-9b29-92e03baa6129 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:34.084633 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-915eeb70-3732-406d-9b29-92e03baa6129 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:34.087602 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-915eeb70-3732-406d-9b29-92e03baa6129 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:34.090097 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-915eeb70-3732-406d-9b29-92e03baa6129 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:34.092219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-915eeb70-3732-406d-9b29-92e03baa6129 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:34.857701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d85c5991-4a95-4101-86d0-dc5995196f48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:34.870544 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d85c5991-4a95-4101-86d0-dc5995196f48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 1.375684 Jan 28 20:26:34.875954 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 37/81] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:33 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:34.903349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ed06c56a-53d4-468f-a9f3-9a3aa9aaa105 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:34.904004 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ed06c56a-53d4-468f-a9f3-9a3aa9aaa105 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:34.924061 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ed06c56a-53d4-468f-a9f3-9a3aa9aaa105 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:34.925207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ed06c56a-53d4-468f-a9f3-9a3aa9aaa105 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:34.926181 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ed06c56a-53d4-468f-a9f3-9a3aa9aaa105 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:34.926910 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ed06c56a-53d4-468f-a9f3-9a3aa9aaa105 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:35.162753 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-915eeb70-3732-406d-9b29-92e03baa6129 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:35.174345 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-915eeb70-3732-406d-9b29-92e03baa6129 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 1.105163 Jan 28 20:26:35.175668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 45/82] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:34 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:35.563558 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ed06c56a-53d4-468f-a9f3-9a3aa9aaa105 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:35.569320 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-780115e6-0b6a-43c6-923b-a3986a3a60c3 req-7f53fc1f-a2ce-449e-8105-d5356d71f1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d03f1de-078d-4fff-aec4-7c91aaaa1eed", "tag": "0b4a5fea-0598-489d-9e45-fc3ffbb44916"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:35.573507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:26:35.573507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:26:35.576857 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ed06c56a-53d4-468f-a9f3-9a3aa9aaa105 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.689023 Jan 28 20:26:35.588217 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 38/83] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:34 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:35.630325 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-780115e6-0b6a-43c6-923b-a3986a3a60c3 req-7f53fc1f-a2ce-449e-8105-d5356d71f1b3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:35.634375 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-780115e6-0b6a-43c6-923b-a3986a3a60c3 req-7f53fc1f-a2ce-449e-8105-d5356d71f1b3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:35.694656 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-780115e6-0b6a-43c6-923b-a3986a3a60c3 req-7f53fc1f-a2ce-449e-8105-d5356d71f1b3 service nova] Creating event network-changed:0b4a5fea-0598-489d-9e45-fc3ffbb44916 for instance 0d03f1de-078d-4fff-aec4-7c91aaaa1eed on hv-cinder-82635 Jan 28 20:26:35.699549 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-780115e6-0b6a-43c6-923b-a3986a3a60c3 req-7f53fc1f-a2ce-449e-8105-d5356d71f1b3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 20:26:35.705615 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-515f12b4-059d-4026-8c36-456c17454f08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:35.706230 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-515f12b4-059d-4026-8c36-456c17454f08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:35.707616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-515f12b4-059d-4026-8c36-456c17454f08 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:35.709252 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-515f12b4-059d-4026-8c36-456c17454f08 None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:35.736427 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.compute.rpcapi [None req-515f12b4-059d-4026-8c36-456c17454f08 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 20:26:35.739160 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-515f12b4-059d-4026-8c36-456c17454f08 None None] Releasing lock "compute-rpcapi-router" {{(pid=116276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 20:26:35.771420 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-ff1b54de-fa3e-4ce7-9182-dc69fbf5d46f req-d8766cb9-effe-43cb-9e91-dd0530c8526d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b405f1-b1ca-40f2-b5e4-bcb87f2737e5", "tag": "2ecf8276-1c36-4e6c-99da-0f2b8a872774"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:35.773834 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:26:35.773834 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:26:35.783517 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-515f12b4-059d-4026-8c36-456c17454f08 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.606313 Jan 28 20:26:35.784134 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 46/84] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:35.790620 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:35.796883 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-ff1b54de-fa3e-4ce7-9182-dc69fbf5d46f req-d8766cb9-effe-43cb-9e91-dd0530c8526d service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:35.797275 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-ff1b54de-fa3e-4ce7-9182-dc69fbf5d46f req-d8766cb9-effe-43cb-9e91-dd0530c8526d service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:35.802734 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:35.814520 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:35.814978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:35.816330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:35.816759 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:35.849267 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-ff1b54de-fa3e-4ce7-9182-dc69fbf5d46f req-d8766cb9-effe-43cb-9e91-dd0530c8526d service nova] Creating event network-changed:2ecf8276-1c36-4e6c-99da-0f2b8a872774 for instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 on hv-cinder-82635 Jan 28 20:26:35.849905 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-ff1b54de-fa3e-4ce7-9182-dc69fbf5d46f req-d8766cb9-effe-43cb-9e91-dd0530c8526d service nova] Acquired lock "compute-rpcapi-router" {{(pid=116275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 20:26:35.853056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7ded5fbf-2142-4110-b2b0-155f59ed2cce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:35.853757 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7ded5fbf-2142-4110-b2b0-155f59ed2cce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:35.856245 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7ded5fbf-2142-4110-b2b0-155f59ed2cce None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:35.859529 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7ded5fbf-2142-4110-b2b0-155f59ed2cce None None] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:35.903699 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.compute.rpcapi [None req-7ded5fbf-2142-4110-b2b0-155f59ed2cce None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 20:26:35.904604 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7ded5fbf-2142-4110-b2b0-155f59ed2cce None None] Releasing lock "compute-rpcapi-router" {{(pid=116275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 20:26:35.940288 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7ded5fbf-2142-4110-b2b0-155f59ed2cce None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348678 Jan 28 20:26:35.942911 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 39/85] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:36.393258 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:36.412806 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:36.417623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:36.422793 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8f54dc6d-d0b1-4499-975e-4d9b9c0ce0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.637240 Jan 28 20:26:36.423897 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 47/86] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:35 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:36.429064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b5126f7c-ed87-4416-871a-167866cedda2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:36.433563 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b5126f7c-ed87-4416-871a-167866cedda2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:36.453645 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b5126f7c-ed87-4416-871a-167866cedda2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:36.455773 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b5126f7c-ed87-4416-871a-167866cedda2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:36.457696 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b5126f7c-ed87-4416-871a-167866cedda2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:36.459433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b5126f7c-ed87-4416-871a-167866cedda2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:36.507623 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-30613113-c848-4fc8-a82e-663a7cfeb0c6 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Action: 'create', calling method: .version_select at 0x7fc779932940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1200301044", "metadata": {"Type": "work"}}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:36.509757 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-30613113-c848-4fc8-a82e-663a7cfeb0c6 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:36.510769 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-30613113-c848-4fc8-a82e-663a7cfeb0c6 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.565237 Jan 28 20:26:36.511473 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 40/87] 10.222.0.59 () {60 vars in 1155 bytes} [Fri Jan 28 20:26:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 568 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 20:26:36.535022 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1bc719d4-98ed-4764-a0aa-677599082ae7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:36.540244 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1bc719d4-98ed-4764-a0aa-677599082ae7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:36.579898 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1bc719d4-98ed-4764-a0aa-677599082ae7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:36.581121 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1bc719d4-98ed-4764-a0aa-677599082ae7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:36.585537 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1bc719d4-98ed-4764-a0aa-677599082ae7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:36.596753 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1bc719d4-98ed-4764-a0aa-677599082ae7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:37.103013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b5126f7c-ed87-4416-871a-167866cedda2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:37.118701 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b5126f7c-ed87-4416-871a-167866cedda2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.693446 Jan 28 20:26:37.132815 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 48/88] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:36 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:37.152608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-da7eefe7-d659-4607-bb71-0c169c9ac569 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Action: 'create', calling method: .version_select at 0x7fc77a152dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-171370605", "metadata": {"Type": "work"}}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:37.160767 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-da7eefe7-d659-4607-bb71-0c169c9ac569 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:37.161852 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-da7eefe7-d659-4607-bb71-0c169c9ac569 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027666 Jan 28 20:26:37.162663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 49/89] 10.222.0.59 () {60 vars in 1155 bytes} [Fri Jan 28 20:26:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 20:26:37.183666 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-63d0cb27-151d-4aba-b174-057701548756 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:37.184706 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-63d0cb27-151d-4aba-b174-057701548756 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:37.195726 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-63d0cb27-151d-4aba-b174-057701548756 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:37.196520 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-63d0cb27-151d-4aba-b174-057701548756 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:37.199628 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-63d0cb27-151d-4aba-b174-057701548756 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:37.202278 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-63d0cb27-151d-4aba-b174-057701548756 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:37.651097 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1bc719d4-98ed-4764-a0aa-677599082ae7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:37.660662 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1bc719d4-98ed-4764-a0aa-677599082ae7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 1.147862 Jan 28 20:26:37.664337 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 41/90] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:36 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:37.672803 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-afd0b760-ef94-4afe-9c49-d67ca56c9b7e tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Action: 'create', calling method: .version_select at 0x7fc77bd063a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-58669724", "metadata": {"Type": "work"}}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:37.685377 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-afd0b760-ef94-4afe-9c49-d67ca56c9b7e tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:37.686485 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-afd0b760-ef94-4afe-9c49-d67ca56c9b7e tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020918 Jan 28 20:26:37.691983 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 42/91] 10.222.0.59 () {60 vars in 1155 bytes} [Fri Jan 28 20:26:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 20:26:37.700948 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:37.701991 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:37.738720 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:37.741551 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:37.743357 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:37.745342 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:37.993347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-63d0cb27-151d-4aba-b174-057701548756 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:38.001091 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-63d0cb27-151d-4aba-b174-057701548756 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.822247 Jan 28 20:26:38.001799 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 50/92] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:37 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:38.006569 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-769ce711-70a8-4205-aeb1-bb253a2ceb74 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Calling method '.version_select at 0x7fc77a152f70>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:38.036788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-769ce711-70a8-4205-aeb1-bb253a2ceb74 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] HTTP exception thrown: Volume tempest-invalid-874449646 could not be found. Jan 28 20:26:38.037570 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-769ce711-70a8-4205-aeb1-bb253a2ceb74 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Returning 404 to user: Volume tempest-invalid-874449646 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:38.038431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-769ce711-70a8-4205-aeb1-bb253a2ceb74 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-874449646" status: 404 len: 98 microversion: 2.1 time: 0.035574 Jan 28 20:26:38.038978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 51/93] 10.222.0.59 () {58 vars in 1214 bytes} [Fri Jan 28 20:26:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-874449646 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 28 20:26:38.045306 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-2b2412d8-2573-4cd2-b9b0-f91a7df09cbb req-225b0782-9329-45a1-a61c-ed77a2f09b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f87e725-240c-4b00-836b-4e5e8a4f0916", "tag": "54934fcd-603d-4abb-9727-1c1d86acb034"}, {"name": "network-changed", "server_uuid": "dd446032-56d9-4e84-abd4-85bc3acbc24b", "tag": "37507c9d-22d6-4b55-b7be-87e04e27d5d1"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:38.047020 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:26:38.047020 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:26:38.057696 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-2b2412d8-2573-4cd2-b9b0-f91a7df09cbb req-225b0782-9329-45a1-a61c-ed77a2f09b04 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:38.058182 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-2b2412d8-2573-4cd2-b9b0-f91a7df09cbb req-225b0782-9329-45a1-a61c-ed77a2f09b04 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:38.070720 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-2b2412d8-2573-4cd2-b9b0-f91a7df09cbb req-225b0782-9329-45a1-a61c-ed77a2f09b04 service nova] Creating event network-changed:54934fcd-603d-4abb-9727-1c1d86acb034 for instance 9f87e725-240c-4b00-836b-4e5e8a4f0916 on hv-cinder-82635 Jan 28 20:26:38.071231 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-2b2412d8-2573-4cd2-b9b0-f91a7df09cbb req-225b0782-9329-45a1-a61c-ed77a2f09b04 service nova] Creating event network-changed:37507c9d-22d6-4b55-b7be-87e04e27d5d1 for instance dd446032-56d9-4e84-abd4-85bc3acbc24b on hv-cinder-82635 Jan 28 20:26:38.078966 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:38.079404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-2b2412d8-2573-4cd2-b9b0-f91a7df09cbb req-225b0782-9329-45a1-a61c-ed77a2f09b04 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038749 Jan 28 20:26:38.080108 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 52/94] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:38.086447 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-20406d42-4738-4746-bda9-ca898a68e8d1 req-116e91f0-ce33-475a-a086-65e98d4f5e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9d2426-a27b-4214-b459-f1431e8cd865", "tag": "a7431330-e930-49ae-b76c-bf203d204d59"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:38.087587 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:38.088134 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:26:38.088134 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:26:38.088999 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:38.090498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-43406b77-bbf3-43b9-89b3-7a3ac85087d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.397125 Jan 28 20:26:38.091920 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 43/95] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:37 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:38.096287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-90196683-f98f-4924-8eb4-4bd9e48bcf4d tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003295 Jan 28 20:26:38.100606 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 44/96] 10.222.0.59 () {58 vars in 1139 bytes} [Fri Jan 28 20:26:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 20:26:38.104981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5170ddfd-f108-42d1-aa81-cc9862939fff tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003209 Jan 28 20:26:38.105476 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 45/97] 10.222.0.59 () {58 vars in 1136 bytes} [Fri Jan 28 20:26:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 20:26:38.107244 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-20406d42-4738-4746-bda9-ca898a68e8d1 req-116e91f0-ce33-475a-a086-65e98d4f5e90 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:38.112743 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-20406d42-4738-4746-bda9-ca898a68e8d1 req-116e91f0-ce33-475a-a086-65e98d4f5e90 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:38.122525 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5cdc1e02-cad4-4760-ab7f-8c727b58d51f tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Calling method '.version_select at 0x7fc77a171ee0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:38.129260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-20406d42-4738-4746-bda9-ca898a68e8d1 req-116e91f0-ce33-475a-a086-65e98d4f5e90 service nova] Creating event network-changed:a7431330-e930-49ae-b76c-bf203d204d59 for instance bf9d2426-a27b-4214-b459-f1431e8cd865 on hv-cinder-82635 Jan 28 20:26:38.152959 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-5cdc1e02-cad4-4760-ab7f-8c727b58d51f tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] HTTP exception thrown: Volume 1bd84741-ce2e-4a0e-9c24-05ba2eebe1d0 could not be found. Jan 28 20:26:38.154160 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5cdc1e02-cad4-4760-ab7f-8c727b58d51f tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Returning 404 to user: Volume 1bd84741-ce2e-4a0e-9c24-05ba2eebe1d0 could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:38.155056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5cdc1e02-cad4-4760-ab7f-8c727b58d51f tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/1bd84741-ce2e-4a0e-9c24-05ba2eebe1d0" status: 404 len: 109 microversion: 2.1 time: 0.044639 Jan 28 20:26:38.155844 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 46/98] 10.222.0.59 () {58 vars in 1247 bytes} [Fri Jan 28 20:26:38 2022] DELETE /compute/v2.1/os-volumes/1bd84741-ce2e-4a0e-9c24-05ba2eebe1d0 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 20:26:38.160246 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3544d140-b273-4a46-ba00-e1cb33f5ed24 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:38.161042 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3544d140-b273-4a46-ba00-e1cb33f5ed24 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:38.162688 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-20406d42-4738-4746-bda9-ca898a68e8d1 req-116e91f0-ce33-475a-a086-65e98d4f5e90 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080492 Jan 28 20:26:38.167694 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 53/99] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:38.168843 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3544d140-b273-4a46-ba00-e1cb33f5ed24 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:38.169822 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3544d140-b273-4a46-ba00-e1cb33f5ed24 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:38.170856 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3544d140-b273-4a46-ba00-e1cb33f5ed24 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:38.171835 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3544d140-b273-4a46-ba00-e1cb33f5ed24 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:38.174678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-233e1956-beda-4ecc-8b88-ba7b8f8dcf56 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Calling method '.version_select at 0x7fc77a172700>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:38.201624 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-233e1956-beda-4ecc-8b88-ba7b8f8dcf56 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] HTTP exception thrown: Volume ffb62d0a-fc0f-40d5-bda6-c9f0d6203a9a could not be found. Jan 28 20:26:38.202423 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-233e1956-beda-4ecc-8b88-ba7b8f8dcf56 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] Returning 404 to user: Volume ffb62d0a-fc0f-40d5-bda6-c9f0d6203a9a could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:26:38.203411 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-233e1956-beda-4ecc-8b88-ba7b8f8dcf56 tempest-VolumesNegativeTest-593867471 tempest-VolumesNegativeTest-593867471-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ffb62d0a-fc0f-40d5-bda6-c9f0d6203a9a" status: 404 len: 109 microversion: 2.1 time: 0.033831 Jan 28 20:26:38.204358 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 54/100] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:26:38 2022] GET /compute/v2.1/os-volumes/ffb62d0a-fc0f-40d5-bda6-c9f0d6203a9a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:26:38.324287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3544d140-b273-4a46-ba00-e1cb33f5ed24 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:38.331987 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3544d140-b273-4a46-ba00-e1cb33f5ed24 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.175043 Jan 28 20:26:38.332541 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 47/101] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:38 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:38.683686 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-37d548d4-1d80-47a5-ad6c-3efd22a5eb1b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:38.683686 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-37d548d4-1d80-47a5-ad6c-3efd22a5eb1b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:38.690296 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-37d548d4-1d80-47a5-ad6c-3efd22a5eb1b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:38.690996 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-37d548d4-1d80-47a5-ad6c-3efd22a5eb1b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:38.691863 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-37d548d4-1d80-47a5-ad6c-3efd22a5eb1b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:38.692369 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-37d548d4-1d80-47a5-ad6c-3efd22a5eb1b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:38.924169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-37d548d4-1d80-47a5-ad6c-3efd22a5eb1b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:38.931786 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-37d548d4-1d80-47a5-ad6c-3efd22a5eb1b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.255059 Jan 28 20:26:38.933959 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 55/102] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:38 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:39.020866 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-06f914f5-a3c4-4157-863a-b8592b1c4b04 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:39.022065 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-06f914f5-a3c4-4157-863a-b8592b1c4b04 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:39.037664 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06f914f5-a3c4-4157-863a-b8592b1c4b04 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:39.038327 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06f914f5-a3c4-4157-863a-b8592b1c4b04 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:39.039482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06f914f5-a3c4-4157-863a-b8592b1c4b04 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:39.040376 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06f914f5-a3c4-4157-863a-b8592b1c4b04 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:39.111723 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:39.113157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:39.121283 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:39.123300 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:39.125140 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:39.125831 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:39.207479 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-06f914f5-a3c4-4157-863a-b8592b1c4b04 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:39.222137 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-06f914f5-a3c4-4157-863a-b8592b1c4b04 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.205730 Jan 28 20:26:39.231183 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 48/103] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:39 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:39.331174 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:39.343519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:39.347017 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:39.348274 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0022d043-7aba-46c6-834b-4ad660139008 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.240168 Jan 28 20:26:39.348735 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-24300d9a-e32c-40d6-88ed-c18c36c78d89 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:39.349341 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-24300d9a-e32c-40d6-88ed-c18c36c78d89 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:39.356689 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-24300d9a-e32c-40d6-88ed-c18c36c78d89 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:39.356871 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-24300d9a-e32c-40d6-88ed-c18c36c78d89 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:39.357707 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-24300d9a-e32c-40d6-88ed-c18c36c78d89 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:39.358163 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-24300d9a-e32c-40d6-88ed-c18c36c78d89 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:39.359726 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 56/104] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:39 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:39.593890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-24300d9a-e32c-40d6-88ed-c18c36c78d89 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:39.603398 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-24300d9a-e32c-40d6-88ed-c18c36c78d89 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.258685 Jan 28 20:26:39.606327 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 49/105] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:39 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:39.951790 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c191ae26-bbb8-46f0-9431-40d089604cc2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:39.953014 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c191ae26-bbb8-46f0-9431-40d089604cc2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:39.960997 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c191ae26-bbb8-46f0-9431-40d089604cc2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:39.961443 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c191ae26-bbb8-46f0-9431-40d089604cc2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:39.962264 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c191ae26-bbb8-46f0-9431-40d089604cc2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:39.962692 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c191ae26-bbb8-46f0-9431-40d089604cc2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:40.239282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5aac9067-5647-42fb-8ec6-e45e4ee5d013 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:40.240537 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5aac9067-5647-42fb-8ec6-e45e4ee5d013 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:40.245606 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c191ae26-bbb8-46f0-9431-40d089604cc2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:40.263725 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c191ae26-bbb8-46f0-9431-40d089604cc2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.316544 Jan 28 20:26:40.273426 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5aac9067-5647-42fb-8ec6-e45e4ee5d013 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:40.273426 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5aac9067-5647-42fb-8ec6-e45e4ee5d013 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:40.273426 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5aac9067-5647-42fb-8ec6-e45e4ee5d013 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:40.273426 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5aac9067-5647-42fb-8ec6-e45e4ee5d013 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:40.276051 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 57/106] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:39 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:40.366983 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:40.368007 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:40.381973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:40.382385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:40.403856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:40.403856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:40.667700 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5aac9067-5647-42fb-8ec6-e45e4ee5d013 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:40.678162 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5aac9067-5647-42fb-8ec6-e45e4ee5d013 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.443103 Jan 28 20:26:40.679623 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 50/107] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:40 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:40.697457 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-348d5399-a369-49ce-b0a8-51fc93a6261e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:40.698113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-348d5399-a369-49ce-b0a8-51fc93a6261e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:40.717996 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-348d5399-a369-49ce-b0a8-51fc93a6261e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:40.718583 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-348d5399-a369-49ce-b0a8-51fc93a6261e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:40.719387 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-348d5399-a369-49ce-b0a8-51fc93a6261e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:40.719824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-348d5399-a369-49ce-b0a8-51fc93a6261e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:40.835438 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:40.846328 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:40.852367 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:40.854841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d4252389-0000-4a27-a7fd-f6be2eca5619 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.492451 Jan 28 20:26:40.867507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 58/108] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:40 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:26:40.955703 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-348d5399-a369-49ce-b0a8-51fc93a6261e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:40.966132 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-348d5399-a369-49ce-b0a8-51fc93a6261e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.274293 Jan 28 20:26:40.977771 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 51/109] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:40 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:41.281930 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f755d10b-e1c8-474e-bfe2-368ac6746deb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:41.282728 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f755d10b-e1c8-474e-bfe2-368ac6746deb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:41.292167 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f755d10b-e1c8-474e-bfe2-368ac6746deb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:41.292622 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f755d10b-e1c8-474e-bfe2-368ac6746deb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:41.293417 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f755d10b-e1c8-474e-bfe2-368ac6746deb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:41.296721 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f755d10b-e1c8-474e-bfe2-368ac6746deb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:41.480716 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f755d10b-e1c8-474e-bfe2-368ac6746deb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:41.488731 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f755d10b-e1c8-474e-bfe2-368ac6746deb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.211477 Jan 28 20:26:41.489549 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 59/110] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:41 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:41.697448 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-57f0b511-d12b-4a3c-a011-f92824412cb7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:41.698660 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-57f0b511-d12b-4a3c-a011-f92824412cb7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:41.710078 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57f0b511-d12b-4a3c-a011-f92824412cb7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:41.710801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57f0b511-d12b-4a3c-a011-f92824412cb7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:41.711599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57f0b511-d12b-4a3c-a011-f92824412cb7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:41.712046 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57f0b511-d12b-4a3c-a011-f92824412cb7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:41.875366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:41.876087 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:41.885363 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:41.886162 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:41.888710 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:41.889842 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:41.891980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-57f0b511-d12b-4a3c-a011-f92824412cb7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:41.905387 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-57f0b511-d12b-4a3c-a011-f92824412cb7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.213333 Jan 28 20:26:41.906507 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 52/111] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:41 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:41.985738 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e9ba72e4-ac91-4fbb-844a-6319ef5fb4d1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:41.986381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e9ba72e4-ac91-4fbb-844a-6319ef5fb4d1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:41.999461 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e9ba72e4-ac91-4fbb-844a-6319ef5fb4d1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:42.000147 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e9ba72e4-ac91-4fbb-844a-6319ef5fb4d1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:42.002469 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e9ba72e4-ac91-4fbb-844a-6319ef5fb4d1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:42.004816 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e9ba72e4-ac91-4fbb-844a-6319ef5fb4d1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:42.141173 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:42.159368 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:42.161009 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:42.162246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1003bbbd-f880-4b7c-ab7a-a81c6bac3050 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.291793 Jan 28 20:26:42.175104 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 60/112] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:41 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:26:42.289683 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e9ba72e4-ac91-4fbb-844a-6319ef5fb4d1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:42.302984 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e9ba72e4-ac91-4fbb-844a-6319ef5fb4d1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.322046 Jan 28 20:26:42.304973 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 53/113] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:41 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:42.505590 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c8895e0c-6cc1-416a-9894-c1f6452d1b0a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:42.506235 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c8895e0c-6cc1-416a-9894-c1f6452d1b0a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:42.519774 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c8895e0c-6cc1-416a-9894-c1f6452d1b0a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:42.520224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c8895e0c-6cc1-416a-9894-c1f6452d1b0a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:42.521005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c8895e0c-6cc1-416a-9894-c1f6452d1b0a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:42.521437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c8895e0c-6cc1-416a-9894-c1f6452d1b0a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:42.692575 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c8895e0c-6cc1-416a-9894-c1f6452d1b0a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:42.699849 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c8895e0c-6cc1-416a-9894-c1f6452d1b0a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.198234 Jan 28 20:26:42.700966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 61/114] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:42 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:42.922365 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8bdf3009-daea-41b6-844f-66a6e032cabd tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:42.923599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8bdf3009-daea-41b6-844f-66a6e032cabd tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:42.930788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8bdf3009-daea-41b6-844f-66a6e032cabd tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:42.931447 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8bdf3009-daea-41b6-844f-66a6e032cabd tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:42.932660 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8bdf3009-daea-41b6-844f-66a6e032cabd tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:42.933467 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8bdf3009-daea-41b6-844f-66a6e032cabd tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:43.175789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8bdf3009-daea-41b6-844f-66a6e032cabd tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:43.185762 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8bdf3009-daea-41b6-844f-66a6e032cabd tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.265595 Jan 28 20:26:43.198149 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 54/115] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:42 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:43.209196 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:43.209912 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:43.218416 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:43.219174 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:43.220858 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:43.221489 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:43.322732 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-69c18dbe-1c13-4b51-9b5c-e7dc4b2e0bcf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:43.322732 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-69c18dbe-1c13-4b51-9b5c-e7dc4b2e0bcf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:43.330419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-69c18dbe-1c13-4b51-9b5c-e7dc4b2e0bcf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:43.330884 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-69c18dbe-1c13-4b51-9b5c-e7dc4b2e0bcf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:43.333851 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-69c18dbe-1c13-4b51-9b5c-e7dc4b2e0bcf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:43.334433 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-69c18dbe-1c13-4b51-9b5c-e7dc4b2e0bcf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:43.500083 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:43.511347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:43.518310 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:43.519804 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-73880769-738f-40c5-82d8-a9f3862f5633 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.322060 Jan 28 20:26:43.530437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 62/116] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:43 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:43.601858 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-69c18dbe-1c13-4b51-9b5c-e7dc4b2e0bcf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:43.613442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-69c18dbe-1c13-4b51-9b5c-e7dc4b2e0bcf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.296536 Jan 28 20:26:43.614307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 55/117] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:43 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:43.716692 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-fac51b18-be77-44da-80dd-99231cadd85f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:43.717471 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-fac51b18-be77-44da-80dd-99231cadd85f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:43.723976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fac51b18-be77-44da-80dd-99231cadd85f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:43.724938 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fac51b18-be77-44da-80dd-99231cadd85f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:43.725905 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fac51b18-be77-44da-80dd-99231cadd85f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:43.726323 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fac51b18-be77-44da-80dd-99231cadd85f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:43.865671 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-fac51b18-be77-44da-80dd-99231cadd85f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:43.874165 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-fac51b18-be77-44da-80dd-99231cadd85f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.161449 Jan 28 20:26:43.881401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 63/118] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:43 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:44.204588 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8c9cf697-5e67-4e41-a0b8-0aa80e90b3da tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:44.205383 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8c9cf697-5e67-4e41-a0b8-0aa80e90b3da tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:44.212433 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c9cf697-5e67-4e41-a0b8-0aa80e90b3da tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:44.213467 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c9cf697-5e67-4e41-a0b8-0aa80e90b3da tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:44.214465 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c9cf697-5e67-4e41-a0b8-0aa80e90b3da tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:44.214972 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c9cf697-5e67-4e41-a0b8-0aa80e90b3da tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:44.392924 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8c9cf697-5e67-4e41-a0b8-0aa80e90b3da tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:44.400632 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8c9cf697-5e67-4e41-a0b8-0aa80e90b3da tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.201575 Jan 28 20:26:44.405917 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 56/119] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:44 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:44.547859 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:44.548467 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:44.554517 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:44.555519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:44.556315 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:44.556750 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:44.631287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2bf57c16-fb11-4b70-a89b-24d4b8fe69d9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:44.632101 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2bf57c16-fb11-4b70-a89b-24d4b8fe69d9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:44.639998 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bf57c16-fb11-4b70-a89b-24d4b8fe69d9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:44.640713 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bf57c16-fb11-4b70-a89b-24d4b8fe69d9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:44.641589 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bf57c16-fb11-4b70-a89b-24d4b8fe69d9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:44.642194 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bf57c16-fb11-4b70-a89b-24d4b8fe69d9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:44.754303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:44.763699 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:44.765680 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:44.767076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9a66ebdd-6595-4fd2-a5f6-fde7a7ae854b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.223464 Jan 28 20:26:44.767772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 64/120] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:44 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:26:44.833961 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2bf57c16-fb11-4b70-a89b-24d4b8fe69d9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:44.844743 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2bf57c16-fb11-4b70-a89b-24d4b8fe69d9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.217225 Jan 28 20:26:44.846539 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 57/121] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:44 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:44.890567 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-967533ef-9fa2-4c73-aa56-3e64fe762973 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:44.891416 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-967533ef-9fa2-4c73-aa56-3e64fe762973 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:44.897623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-967533ef-9fa2-4c73-aa56-3e64fe762973 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:44.898103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-967533ef-9fa2-4c73-aa56-3e64fe762973 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:44.898885 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-967533ef-9fa2-4c73-aa56-3e64fe762973 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:44.899317 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-967533ef-9fa2-4c73-aa56-3e64fe762973 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:45.056664 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-967533ef-9fa2-4c73-aa56-3e64fe762973 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:45.070623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-967533ef-9fa2-4c73-aa56-3e64fe762973 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.183726 Jan 28 20:26:45.071192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 65/122] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:44 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:45.419684 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ef789fe3-aa7d-44fc-b0a4-663392ff94f2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:45.421196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ef789fe3-aa7d-44fc-b0a4-663392ff94f2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:45.427275 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ef789fe3-aa7d-44fc-b0a4-663392ff94f2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:45.427879 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ef789fe3-aa7d-44fc-b0a4-663392ff94f2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:45.428975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ef789fe3-aa7d-44fc-b0a4-663392ff94f2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:45.430140 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ef789fe3-aa7d-44fc-b0a4-663392ff94f2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:45.626262 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ef789fe3-aa7d-44fc-b0a4-663392ff94f2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:45.634554 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ef789fe3-aa7d-44fc-b0a4-663392ff94f2 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.219454 Jan 28 20:26:45.635236 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 58/123] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:45 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:45.785377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:45.787134 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:45.793230 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:45.793943 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:45.794808 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:45.795282 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:45.862719 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-aa4baaa0-05dc-46de-8866-1041501d5730 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:45.863572 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-aa4baaa0-05dc-46de-8866-1041501d5730 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:45.871631 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa4baaa0-05dc-46de-8866-1041501d5730 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:45.872764 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa4baaa0-05dc-46de-8866-1041501d5730 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:45.873553 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa4baaa0-05dc-46de-8866-1041501d5730 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:45.874011 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa4baaa0-05dc-46de-8866-1041501d5730 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:46.011908 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:46.025564 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:46.027758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:46.029413 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-037cfbb6-ccb1-42bf-8a4a-a0dd4ff62a5e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.247851 Jan 28 20:26:46.040670 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 66/124] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:45 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:46.086799 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-aa4baaa0-05dc-46de-8866-1041501d5730 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:46.087551 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-243f5328-29de-4893-9ff8-a42ed53c9baf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:46.088799 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-243f5328-29de-4893-9ff8-a42ed53c9baf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:46.095599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-aa4baaa0-05dc-46de-8866-1041501d5730 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.237294 Jan 28 20:26:46.096568 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 59/125] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:45 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:46.097285 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-243f5328-29de-4893-9ff8-a42ed53c9baf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:46.097952 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-243f5328-29de-4893-9ff8-a42ed53c9baf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:46.098751 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-243f5328-29de-4893-9ff8-a42ed53c9baf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:46.099189 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-243f5328-29de-4893-9ff8-a42ed53c9baf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:46.251829 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-243f5328-29de-4893-9ff8-a42ed53c9baf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:46.259145 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-243f5328-29de-4893-9ff8-a42ed53c9baf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.175296 Jan 28 20:26:46.268824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 67/126] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:46 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:46.651956 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-bdf6a049-6069-4ba6-b6f8-5e033ff990d3 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:46.652569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-bdf6a049-6069-4ba6-b6f8-5e033ff990d3 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:46.660131 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-bdf6a049-6069-4ba6-b6f8-5e033ff990d3 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:46.661080 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-bdf6a049-6069-4ba6-b6f8-5e033ff990d3 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:46.662253 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-bdf6a049-6069-4ba6-b6f8-5e033ff990d3 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:46.662832 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-bdf6a049-6069-4ba6-b6f8-5e033ff990d3 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:46.842224 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-bdf6a049-6069-4ba6-b6f8-5e033ff990d3 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:46.849562 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-bdf6a049-6069-4ba6-b6f8-5e033ff990d3 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.201285 Jan 28 20:26:46.850175 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 60/127] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:46 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:47.050385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:47.051824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:47.060539 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:47.060990 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:47.062779 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:47.063217 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:47.114330 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c5b6c215-9e71-4b38-b0e1-906ccc509702 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:47.114941 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c5b6c215-9e71-4b38-b0e1-906ccc509702 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:47.121759 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5b6c215-9e71-4b38-b0e1-906ccc509702 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:47.122839 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5b6c215-9e71-4b38-b0e1-906ccc509702 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:47.124795 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5b6c215-9e71-4b38-b0e1-906ccc509702 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:47.124795 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5b6c215-9e71-4b38-b0e1-906ccc509702 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:47.416308 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:47.429253 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:47.430956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:47.432366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d908b82c-6e86-4348-aa52-2e53e17c5a82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.388540 Jan 28 20:26:47.433502 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 68/128] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:47 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:47.438631 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ef7fdb6f-d285-4c7a-9207-d0997b8397ff tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:47.439515 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ef7fdb6f-d285-4c7a-9207-d0997b8397ff tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:47.446471 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ef7fdb6f-d285-4c7a-9207-d0997b8397ff tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:47.447336 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ef7fdb6f-d285-4c7a-9207-d0997b8397ff tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:47.448329 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ef7fdb6f-d285-4c7a-9207-d0997b8397ff tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:47.448957 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ef7fdb6f-d285-4c7a-9207-d0997b8397ff tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:47.515436 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c5b6c215-9e71-4b38-b0e1-906ccc509702 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:47.528748 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c5b6c215-9e71-4b38-b0e1-906ccc509702 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.415993 Jan 28 20:26:47.530056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 61/129] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:47 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:47.672535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ef7fdb6f-d285-4c7a-9207-d0997b8397ff tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:47.681358 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ef7fdb6f-d285-4c7a-9207-d0997b8397ff tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.246423 Jan 28 20:26:47.681972 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 69/130] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:47 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:47.870350 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6ed7cd1f-54c3-429b-b826-c6dad9f7145b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:47.871174 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6ed7cd1f-54c3-429b-b826-c6dad9f7145b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:47.877306 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd1f-54c3-429b-b826-c6dad9f7145b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:47.877766 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd1f-54c3-429b-b826-c6dad9f7145b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:47.878579 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd1f-54c3-429b-b826-c6dad9f7145b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:47.879213 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd1f-54c3-429b-b826-c6dad9f7145b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:48.031326 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6ed7cd1f-54c3-429b-b826-c6dad9f7145b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:48.039706 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6ed7cd1f-54c3-429b-b826-c6dad9f7145b tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.176295 Jan 28 20:26:48.040285 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 62/131] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:47 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:48.450522 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:48.451183 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:48.458217 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:48.458660 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:48.459430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:48.459848 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:48.548751 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3fa2c611-4692-4003-bd32-3a018db8ad1f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:48.548751 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3fa2c611-4692-4003-bd32-3a018db8ad1f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:48.553654 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3fa2c611-4692-4003-bd32-3a018db8ad1f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:48.554360 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3fa2c611-4692-4003-bd32-3a018db8ad1f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:48.555346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3fa2c611-4692-4003-bd32-3a018db8ad1f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:48.556163 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3fa2c611-4692-4003-bd32-3a018db8ad1f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:48.647353 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:48.655706 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:48.657742 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:48.659225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b58ae5dc-e56b-4d92-aa49-08c726dabe5d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.212342 Jan 28 20:26:48.660434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 70/132] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:48 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:48.697687 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-95d360b7-d99d-48ad-91ba-23361f775966 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:48.698494 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-95d360b7-d99d-48ad-91ba-23361f775966 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:48.704496 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-95d360b7-d99d-48ad-91ba-23361f775966 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:48.705129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-95d360b7-d99d-48ad-91ba-23361f775966 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:48.706097 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-95d360b7-d99d-48ad-91ba-23361f775966 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:48.706685 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-95d360b7-d99d-48ad-91ba-23361f775966 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:48.783941 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3fa2c611-4692-4003-bd32-3a018db8ad1f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:48.796565 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3fa2c611-4692-4003-bd32-3a018db8ad1f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.254305 Jan 28 20:26:48.807044 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 63/133] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:48 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:48.860489 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-95d360b7-d99d-48ad-91ba-23361f775966 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:48.870921 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-95d360b7-d99d-48ad-91ba-23361f775966 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.176556 Jan 28 20:26:48.872169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 71/134] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:48 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:49.056371 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-86ff8906-944a-4ada-a8a9-ec1726c60d03 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:49.056982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-86ff8906-944a-4ada-a8a9-ec1726c60d03 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:49.062733 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86ff8906-944a-4ada-a8a9-ec1726c60d03 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:49.063179 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86ff8906-944a-4ada-a8a9-ec1726c60d03 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:49.063946 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86ff8906-944a-4ada-a8a9-ec1726c60d03 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:49.064375 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86ff8906-944a-4ada-a8a9-ec1726c60d03 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:49.197058 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-86ff8906-944a-4ada-a8a9-ec1726c60d03 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:49.204746 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-86ff8906-944a-4ada-a8a9-ec1726c60d03 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.152112 Jan 28 20:26:49.205298 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 64/135] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:49 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:49.677570 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:49.678190 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:49.684074 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:49.684512 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:49.685267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:49.685688 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:49.813592 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-783a6e9a-8d00-4b8b-9c34-ed8687687a33 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:49.814230 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-783a6e9a-8d00-4b8b-9c34-ed8687687a33 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:49.820085 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-783a6e9a-8d00-4b8b-9c34-ed8687687a33 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:49.820600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-783a6e9a-8d00-4b8b-9c34-ed8687687a33 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:49.821490 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-783a6e9a-8d00-4b8b-9c34-ed8687687a33 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:49.822026 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-783a6e9a-8d00-4b8b-9c34-ed8687687a33 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:49.828950 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:49.836527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:49.838027 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:49.839110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0ff1b0fa-f830-4334-b086-118dc1587bd5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.165218 Jan 28 20:26:49.839671 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 72/136] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:49 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:49.888764 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-83544f47-2049-4027-8e0a-e7ba3fc92e80 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:49.889510 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-83544f47-2049-4027-8e0a-e7ba3fc92e80 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:49.895095 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-83544f47-2049-4027-8e0a-e7ba3fc92e80 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:49.895526 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-83544f47-2049-4027-8e0a-e7ba3fc92e80 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:49.896281 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-83544f47-2049-4027-8e0a-e7ba3fc92e80 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:49.896706 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-83544f47-2049-4027-8e0a-e7ba3fc92e80 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:49.980481 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-783a6e9a-8d00-4b8b-9c34-ed8687687a33 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:49.993639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-783a6e9a-8d00-4b8b-9c34-ed8687687a33 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.182261 Jan 28 20:26:49.993639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 65/137] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:49 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:50.067431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-83544f47-2049-4027-8e0a-e7ba3fc92e80 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:50.075124 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-83544f47-2049-4027-8e0a-e7ba3fc92e80 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.190635 Jan 28 20:26:50.075689 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 73/138] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:49 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:50.220969 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c496566f-25ba-4dcf-bf66-2ac675b679fc tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:50.221575 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c496566f-25ba-4dcf-bf66-2ac675b679fc tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:50.227397 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c496566f-25ba-4dcf-bf66-2ac675b679fc tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:50.227841 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c496566f-25ba-4dcf-bf66-2ac675b679fc tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:50.228613 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c496566f-25ba-4dcf-bf66-2ac675b679fc tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:50.229041 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c496566f-25ba-4dcf-bf66-2ac675b679fc tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:50.357221 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c496566f-25ba-4dcf-bf66-2ac675b679fc tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:50.364498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c496566f-25ba-4dcf-bf66-2ac675b679fc tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.147228 Jan 28 20:26:50.365064 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 66/139] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:50 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:50.857272 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:50.857897 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:50.863881 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:50.864316 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:50.865076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:50.865505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:50.995549 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:51.006977 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:51.008477 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:51.009561 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9e372cfe-7430-4fe9-846e-393ca78cbd21 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.156018 Jan 28 20:26:51.010030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b00f4911-9c51-4f48-bd8f-e0d30eb5734a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:51.010172 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 74/140] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:50 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:51.010946 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b00f4911-9c51-4f48-bd8f-e0d30eb5734a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:51.017566 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b00f4911-9c51-4f48-bd8f-e0d30eb5734a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:51.018058 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b00f4911-9c51-4f48-bd8f-e0d30eb5734a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:51.018853 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b00f4911-9c51-4f48-bd8f-e0d30eb5734a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:51.019286 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b00f4911-9c51-4f48-bd8f-e0d30eb5734a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:51.103118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-95ed537c-0fe6-4b39-8112-6bdb4cc3ac9a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:51.103118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-95ed537c-0fe6-4b39-8112-6bdb4cc3ac9a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:51.103118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-95ed537c-0fe6-4b39-8112-6bdb4cc3ac9a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:51.103118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-95ed537c-0fe6-4b39-8112-6bdb4cc3ac9a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:51.103452 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-95ed537c-0fe6-4b39-8112-6bdb4cc3ac9a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:51.103690 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-95ed537c-0fe6-4b39-8112-6bdb4cc3ac9a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:51.193784 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b00f4911-9c51-4f48-bd8f-e0d30eb5734a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:51.201606 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b00f4911-9c51-4f48-bd8f-e0d30eb5734a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.195405 Jan 28 20:26:51.202202 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 67/141] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:51 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:51.255407 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-95ed537c-0fe6-4b39-8112-6bdb4cc3ac9a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:51.263379 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-95ed537c-0fe6-4b39-8112-6bdb4cc3ac9a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.171200 Jan 28 20:26:51.263952 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 75/142] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:51 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:51.381075 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6e6935f6-1436-430c-a048-2b096018f371 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:51.381609 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6e6935f6-1436-430c-a048-2b096018f371 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:51.388154 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6e6935f6-1436-430c-a048-2b096018f371 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:51.388600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6e6935f6-1436-430c-a048-2b096018f371 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:51.389381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6e6935f6-1436-430c-a048-2b096018f371 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:51.389816 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6e6935f6-1436-430c-a048-2b096018f371 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:51.524398 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6e6935f6-1436-430c-a048-2b096018f371 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:51.531761 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6e6935f6-1436-430c-a048-2b096018f371 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.154336 Jan 28 20:26:51.532322 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 68/143] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:51 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:52.027702 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:52.028828 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:52.046424 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:52.047035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:52.047840 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:52.048272 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:52.179227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:52.186964 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:52.188468 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:52.189554 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-cd31ab3b-e292-4949-bb96-1602b398aa9b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.165491 Jan 28 20:26:52.190124 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 76/144] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:52 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:52.218644 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7e9c1382-b613-4b52-a86e-febd62919ccc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:52.219249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7e9c1382-b613-4b52-a86e-febd62919ccc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:52.225062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e9c1382-b613-4b52-a86e-febd62919ccc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:52.225502 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e9c1382-b613-4b52-a86e-febd62919ccc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:52.226338 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e9c1382-b613-4b52-a86e-febd62919ccc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:52.226766 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e9c1382-b613-4b52-a86e-febd62919ccc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:52.280267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a316b204-bdca-4656-91d9-7c36b3b75679 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:52.281141 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a316b204-bdca-4656-91d9-7c36b3b75679 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:52.286927 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a316b204-bdca-4656-91d9-7c36b3b75679 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:52.287378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a316b204-bdca-4656-91d9-7c36b3b75679 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:52.288151 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a316b204-bdca-4656-91d9-7c36b3b75679 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:52.288578 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a316b204-bdca-4656-91d9-7c36b3b75679 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:52.391988 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7e9c1382-b613-4b52-a86e-febd62919ccc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:52.399138 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7e9c1382-b613-4b52-a86e-febd62919ccc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.184871 Jan 28 20:26:52.399700 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 69/145] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:52 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:52.451007 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a316b204-bdca-4656-91d9-7c36b3b75679 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:52.458257 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a316b204-bdca-4656-91d9-7c36b3b75679 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.182211 Jan 28 20:26:52.458812 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 77/146] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:52 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:52.548668 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-86cceb88-2b53-4360-aaa7-360954da7d2a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:52.549199 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-86cceb88-2b53-4360-aaa7-360954da7d2a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:52.554921 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86cceb88-2b53-4360-aaa7-360954da7d2a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:52.555363 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86cceb88-2b53-4360-aaa7-360954da7d2a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:52.556131 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86cceb88-2b53-4360-aaa7-360954da7d2a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:52.556561 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86cceb88-2b53-4360-aaa7-360954da7d2a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:52.691484 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-86cceb88-2b53-4360-aaa7-360954da7d2a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:52.698647 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-86cceb88-2b53-4360-aaa7-360954da7d2a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.153757 Jan 28 20:26:52.699210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 70/147] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:52 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:53.206743 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:53.207395 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:53.213903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:53.214352 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:53.215169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:53.215594 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:53.350946 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:53.359807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:53.361328 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:53.362948 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-158c6e76-ba59-496e-99a4-68310134fb48 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.159595 Jan 28 20:26:53.363608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 78/148] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:53 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:53.416236 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-71e75991-f3e8-4447-9f8e-59f29274f5b5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:53.416840 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-71e75991-f3e8-4447-9f8e-59f29274f5b5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:53.423273 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-71e75991-f3e8-4447-9f8e-59f29274f5b5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:53.423723 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-71e75991-f3e8-4447-9f8e-59f29274f5b5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:53.424495 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-71e75991-f3e8-4447-9f8e-59f29274f5b5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:53.424926 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-71e75991-f3e8-4447-9f8e-59f29274f5b5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:53.475482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f55c6f2d-f11c-42e3-96c7-ff2a673b8eba tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:53.476099 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f55c6f2d-f11c-42e3-96c7-ff2a673b8eba tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:53.482467 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f55c6f2d-f11c-42e3-96c7-ff2a673b8eba tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:53.482876 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f55c6f2d-f11c-42e3-96c7-ff2a673b8eba tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:53.483654 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f55c6f2d-f11c-42e3-96c7-ff2a673b8eba tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:53.484084 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f55c6f2d-f11c-42e3-96c7-ff2a673b8eba tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:53.589405 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-71e75991-f3e8-4447-9f8e-59f29274f5b5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:53.599000 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-71e75991-f3e8-4447-9f8e-59f29274f5b5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.186288 Jan 28 20:26:53.600207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 71/149] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:53 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:53.666374 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f55c6f2d-f11c-42e3-96c7-ff2a673b8eba tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:53.674536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f55c6f2d-f11c-42e3-96c7-ff2a673b8eba tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.202763 Jan 28 20:26:53.675134 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 79/150] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:53 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:53.716247 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8372e841-befb-4357-b5df-50a85ffb4a87 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:53.716853 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8372e841-befb-4357-b5df-50a85ffb4a87 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:53.722678 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8372e841-befb-4357-b5df-50a85ffb4a87 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:53.723134 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8372e841-befb-4357-b5df-50a85ffb4a87 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:53.723915 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8372e841-befb-4357-b5df-50a85ffb4a87 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:53.724349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8372e841-befb-4357-b5df-50a85ffb4a87 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:53.865138 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8372e841-befb-4357-b5df-50a85ffb4a87 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:53.872366 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8372e841-befb-4357-b5df-50a85ffb4a87 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.160400 Jan 28 20:26:53.872936 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 72/151] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:53 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:54.380542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:54.381751 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:54.397636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:54.397636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:54.397636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:54.397636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:54.536522 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:54.544617 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:54.546134 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:54.547255 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b952bd4b-f0fc-41b2-ab84-2d396067a4d9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.170697 Jan 28 20:26:54.548336 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 80/152] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:54 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:54.616853 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3b44b7f1-5427-48de-a2fd-aeed93d7b85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:54.617487 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3b44b7f1-5427-48de-a2fd-aeed93d7b85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:54.623408 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b44b7f1-5427-48de-a2fd-aeed93d7b85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:54.623873 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b44b7f1-5427-48de-a2fd-aeed93d7b85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:54.624635 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b44b7f1-5427-48de-a2fd-aeed93d7b85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:54.625104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b44b7f1-5427-48de-a2fd-aeed93d7b85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:54.690875 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-15ecc861-a082-4058-bf63-e6af93a1d4ce tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:54.691559 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-15ecc861-a082-4058-bf63-e6af93a1d4ce tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:54.698091 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-15ecc861-a082-4058-bf63-e6af93a1d4ce tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:54.698559 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-15ecc861-a082-4058-bf63-e6af93a1d4ce tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:54.699324 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-15ecc861-a082-4058-bf63-e6af93a1d4ce tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:54.700253 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-15ecc861-a082-4058-bf63-e6af93a1d4ce tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:54.787659 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3b44b7f1-5427-48de-a2fd-aeed93d7b85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:54.795086 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3b44b7f1-5427-48de-a2fd-aeed93d7b85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.181789 Jan 28 20:26:54.795932 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 73/153] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:54 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:54.852424 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-15ecc861-a082-4058-bf63-e6af93a1d4ce tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:54.860211 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-15ecc861-a082-4058-bf63-e6af93a1d4ce tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.172930 Jan 28 20:26:54.860826 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 81/154] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:54 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:54.889077 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-368c050d-21a7-4eff-a7c0-ec33da950eec tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:54.889694 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-368c050d-21a7-4eff-a7c0-ec33da950eec tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:54.896739 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-368c050d-21a7-4eff-a7c0-ec33da950eec tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:54.897203 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-368c050d-21a7-4eff-a7c0-ec33da950eec tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:54.898060 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-368c050d-21a7-4eff-a7c0-ec33da950eec tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:54.898550 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-368c050d-21a7-4eff-a7c0-ec33da950eec tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:55.039127 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-368c050d-21a7-4eff-a7c0-ec33da950eec tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:55.046296 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-368c050d-21a7-4eff-a7c0-ec33da950eec tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.161554 Jan 28 20:26:55.046858 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 74/155] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:54 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:55.564958 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:55.565514 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:55.573144 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:55.573843 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:55.575415 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:55.575853 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:55.741976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:55.750583 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:55.752078 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:55.753176 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-da98c057-f259-4825-ba70-76cbbab1d461 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.192392 Jan 28 20:26:55.764084 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 82/156] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:55 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:55.813359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d328c4e6-c214-468f-b682-71d8498abe48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:55.813988 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d328c4e6-c214-468f-b682-71d8498abe48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:55.824051 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d328c4e6-c214-468f-b682-71d8498abe48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:55.824510 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d328c4e6-c214-468f-b682-71d8498abe48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:55.825435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d328c4e6-c214-468f-b682-71d8498abe48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:55.825865 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d328c4e6-c214-468f-b682-71d8498abe48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:55.877434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f963eab1-a9c3-48a9-97d7-f6bb2de4fc4f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:55.878310 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f963eab1-a9c3-48a9-97d7-f6bb2de4fc4f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:55.885248 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f963eab1-a9c3-48a9-97d7-f6bb2de4fc4f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:55.886442 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f963eab1-a9c3-48a9-97d7-f6bb2de4fc4f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:55.887991 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f963eab1-a9c3-48a9-97d7-f6bb2de4fc4f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:55.888639 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f963eab1-a9c3-48a9-97d7-f6bb2de4fc4f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:56.037405 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d328c4e6-c214-468f-b682-71d8498abe48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:56.054417 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d328c4e6-c214-468f-b682-71d8498abe48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.245228 Jan 28 20:26:56.055003 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 75/157] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:55 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:56.077732 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b4e13e64-065c-4935-b57f-90d32637fb29 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:56.078482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b4e13e64-065c-4935-b57f-90d32637fb29 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:56.087772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f963eab1-a9c3-48a9-97d7-f6bb2de4fc4f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:56.094526 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4e13e64-065c-4935-b57f-90d32637fb29 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:56.094712 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4e13e64-065c-4935-b57f-90d32637fb29 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:56.097034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4e13e64-065c-4935-b57f-90d32637fb29 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:56.098135 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4e13e64-065c-4935-b57f-90d32637fb29 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:56.099381 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f963eab1-a9c3-48a9-97d7-f6bb2de4fc4f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.226031 Jan 28 20:26:56.100092 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 83/158] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:55 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:56.255907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b4e13e64-065c-4935-b57f-90d32637fb29 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:56.263776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b4e13e64-065c-4935-b57f-90d32637fb29 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.192599 Jan 28 20:26:56.265248 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 76/159] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:56 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:56.771514 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:56.772123 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:56.778927 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:56.779372 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:56.780167 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:56.780852 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:56.786594 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-a973c79f-9061-442f-bbce-e534b3a7198e req-268df935-740f-4411-b4cf-caca68ccf182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f87e725-240c-4b00-836b-4e5e8a4f0916", "name": "network-vif-plugged", "status": "completed", "tag": "54934fcd-603d-4abb-9727-1c1d86acb034"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:56.789526 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:26:56.789526 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:26:56.804681 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-a973c79f-9061-442f-bbce-e534b3a7198e req-268df935-740f-4411-b4cf-caca68ccf182 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:56.805205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-a973c79f-9061-442f-bbce-e534b3a7198e req-268df935-740f-4411-b4cf-caca68ccf182 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:56.822710 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-a973c79f-9061-442f-bbce-e534b3a7198e req-268df935-740f-4411-b4cf-caca68ccf182 service nova] Creating event network-vif-plugged:54934fcd-603d-4abb-9727-1c1d86acb034 for instance 9f87e725-240c-4b00-836b-4e5e8a4f0916 on hv-cinder-82635 Jan 28 20:26:56.828650 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-a973c79f-9061-442f-bbce-e534b3a7198e req-268df935-740f-4411-b4cf-caca68ccf182 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110257 Jan 28 20:26:56.829427 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 84/160] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:26:56.952547 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:56.963742 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:56.965398 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:56.967344 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e14566f5-9c7b-4a51-a05c-b4c484227501 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.199468 Jan 28 20:26:56.977974 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 77/161] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:56 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:57.073404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b1ad0ad7-a469-49df-ab1f-44790cf98bfb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:57.074346 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b1ad0ad7-a469-49df-ab1f-44790cf98bfb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:57.085317 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1ad0ad7-a469-49df-ab1f-44790cf98bfb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:57.085767 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1ad0ad7-a469-49df-ab1f-44790cf98bfb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:57.086600 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1ad0ad7-a469-49df-ab1f-44790cf98bfb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:57.087034 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1ad0ad7-a469-49df-ab1f-44790cf98bfb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:57.118357 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c367260f-2013-4728-98e0-ee644b67989d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:57.118980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c367260f-2013-4728-98e0-ee644b67989d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:57.138615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c367260f-2013-4728-98e0-ee644b67989d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:57.144153 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c367260f-2013-4728-98e0-ee644b67989d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:57.144994 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c367260f-2013-4728-98e0-ee644b67989d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:57.146867 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c367260f-2013-4728-98e0-ee644b67989d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:57.410108 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b1ad0ad7-a469-49df-ab1f-44790cf98bfb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:57.417394 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b1ad0ad7-a469-49df-ab1f-44790cf98bfb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.349616 Jan 28 20:26:57.418011 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 85/162] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:57 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:57.431060 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4eef39f1-aba4-43b6-875d-6cdbaeb5a52c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:57.433269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4eef39f1-aba4-43b6-875d-6cdbaeb5a52c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:57.449574 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4eef39f1-aba4-43b6-875d-6cdbaeb5a52c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:57.450085 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4eef39f1-aba4-43b6-875d-6cdbaeb5a52c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:57.450883 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4eef39f1-aba4-43b6-875d-6cdbaeb5a52c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:57.451306 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4eef39f1-aba4-43b6-875d-6cdbaeb5a52c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:57.513504 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c367260f-2013-4728-98e0-ee644b67989d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:57.521721 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c367260f-2013-4728-98e0-ee644b67989d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.408897 Jan 28 20:26:57.525521 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 78/163] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:57 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:57.677142 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4eef39f1-aba4-43b6-875d-6cdbaeb5a52c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:57.685186 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4eef39f1-aba4-43b6-875d-6cdbaeb5a52c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.265640 Jan 28 20:26:57.685755 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 86/164] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:57 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:57.984975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:57.985590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:57.991817 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:57.992517 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:57.993517 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:57.993974 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:58.168094 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:58.176573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:58.178218 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:58.179773 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-25ab04f2-0180-4936-ad1d-a77dcb0297e5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.199216 Jan 28 20:26:58.180439 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 79/165] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:57 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:58.434832 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2ae4fb74-d512-4226-bc62-c438b96bc85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:58.435448 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2ae4fb74-d512-4226-bc62-c438b96bc85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:58.444090 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2ae4fb74-d512-4226-bc62-c438b96bc85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:58.444755 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2ae4fb74-d512-4226-bc62-c438b96bc85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:58.445580 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2ae4fb74-d512-4226-bc62-c438b96bc85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:58.446423 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2ae4fb74-d512-4226-bc62-c438b96bc85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:58.540895 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6c5455e1-931f-4a5f-996f-be26edea1f0d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:58.541492 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6c5455e1-931f-4a5f-996f-be26edea1f0d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:58.547518 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6c5455e1-931f-4a5f-996f-be26edea1f0d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:58.547954 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6c5455e1-931f-4a5f-996f-be26edea1f0d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:58.548727 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6c5455e1-931f-4a5f-996f-be26edea1f0d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:58.549320 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6c5455e1-931f-4a5f-996f-be26edea1f0d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:58.608744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2ae4fb74-d512-4226-bc62-c438b96bc85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:58.620530 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2ae4fb74-d512-4226-bc62-c438b96bc85d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.189256 Jan 28 20:26:58.622515 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 87/166] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:58 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:58.702749 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b792ab01-ed46-4bf5-a972-551fa5ef68f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:58.703436 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b792ab01-ed46-4bf5-a972-551fa5ef68f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:58.710789 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b792ab01-ed46-4bf5-a972-551fa5ef68f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:58.711527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b792ab01-ed46-4bf5-a972-551fa5ef68f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:58.712567 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b792ab01-ed46-4bf5-a972-551fa5ef68f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:58.713027 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b792ab01-ed46-4bf5-a972-551fa5ef68f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:58.732485 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6c5455e1-931f-4a5f-996f-be26edea1f0d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:58.740905 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6c5455e1-931f-4a5f-996f-be26edea1f0d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.203420 Jan 28 20:26:58.752340 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 80/167] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:58 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:58.845799 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-bf74a538-a3c0-4062-850d-e68a723a4219 req-178a2d6e-51af-4893-a051-6322bb3d62cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9d2426-a27b-4214-b459-f1431e8cd865", "name": "network-vif-plugged", "status": "completed", "tag": "a7431330-e930-49ae-b76c-bf203d204d59"}, {"server_uuid": "0d03f1de-078d-4fff-aec4-7c91aaaa1eed", "name": "network-vif-plugged", "status": "completed", "tag": "0b4a5fea-0598-489d-9e45-fc3ffbb44916"}, {"server_uuid": "dd446032-56d9-4e84-abd4-85bc3acbc24b", "name": "network-vif-plugged", "status": "completed", "tag": "37507c9d-22d6-4b55-b7be-87e04e27d5d1"}, {"server_uuid": "45b405f1-b1ca-40f2-b5e4-bcb87f2737e5", "name": "network-vif-plugged", "status": "completed", "tag": "2ecf8276-1c36-4e6c-99da-0f2b8a872774"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:26:58.848496 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:26:58.848496 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:26:58.869763 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-bf74a538-a3c0-4062-850d-e68a723a4219 req-178a2d6e-51af-4893-a051-6322bb3d62cf service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:58.870229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-bf74a538-a3c0-4062-850d-e68a723a4219 req-178a2d6e-51af-4893-a051-6322bb3d62cf service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:58.897710 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-bf74a538-a3c0-4062-850d-e68a723a4219 req-178a2d6e-51af-4893-a051-6322bb3d62cf service nova] Creating event network-vif-plugged:a7431330-e930-49ae-b76c-bf203d204d59 for instance bf9d2426-a27b-4214-b459-f1431e8cd865 on hv-cinder-82635 Jan 28 20:26:58.898307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-bf74a538-a3c0-4062-850d-e68a723a4219 req-178a2d6e-51af-4893-a051-6322bb3d62cf service nova] Creating event network-vif-plugged:0b4a5fea-0598-489d-9e45-fc3ffbb44916 for instance 0d03f1de-078d-4fff-aec4-7c91aaaa1eed on hv-cinder-82635 Jan 28 20:26:58.898797 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-bf74a538-a3c0-4062-850d-e68a723a4219 req-178a2d6e-51af-4893-a051-6322bb3d62cf service nova] Creating event network-vif-plugged:37507c9d-22d6-4b55-b7be-87e04e27d5d1 for instance dd446032-56d9-4e84-abd4-85bc3acbc24b on hv-cinder-82635 Jan 28 20:26:58.900916 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-bf74a538-a3c0-4062-850d-e68a723a4219 req-178a2d6e-51af-4893-a051-6322bb3d62cf service nova] Creating event network-vif-plugged:2ecf8276-1c36-4e6c-99da-0f2b8a872774 for instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 on hv-cinder-82635 Jan 28 20:26:58.911341 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-bf74a538-a3c0-4062-850d-e68a723a4219 req-178a2d6e-51af-4893-a051-6322bb3d62cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.069541 Jan 28 20:26:58.915744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 81/168] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:26:58.977481 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b792ab01-ed46-4bf5-a972-551fa5ef68f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:59.010788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b792ab01-ed46-4bf5-a972-551fa5ef68f8 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.312426 Jan 28 20:26:59.011382 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 88/169] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:58 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:26:59.198095 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:59.199373 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:59.207736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:59.212293 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:59.213369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:59.214048 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:59.509673 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:59.517375 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:59.519359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:59.520466 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-08ce44ff-95e5-4091-be5f-f7fa19af5e16 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.326486 Jan 28 20:26:59.521012 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 82/170] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:26:59 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:26:59.639425 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e08c4011-548c-495f-9ea3-4c67b6757f0a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:59.640056 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e08c4011-548c-495f-9ea3-4c67b6757f0a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:59.646022 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e08c4011-548c-495f-9ea3-4c67b6757f0a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:59.646550 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e08c4011-548c-495f-9ea3-4c67b6757f0a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:59.647273 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e08c4011-548c-495f-9ea3-4c67b6757f0a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:59.647788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e08c4011-548c-495f-9ea3-4c67b6757f0a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:59.758118 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e5af2aef-1b25-4610-a920-7e300205d473 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:26:59.759266 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e5af2aef-1b25-4610-a920-7e300205d473 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:26:59.767653 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e5af2aef-1b25-4610-a920-7e300205d473 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:59.768106 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e5af2aef-1b25-4610-a920-7e300205d473 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:59.768911 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e5af2aef-1b25-4610-a920-7e300205d473 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:26:59.769346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e5af2aef-1b25-4610-a920-7e300205d473 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:26:59.799966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e08c4011-548c-495f-9ea3-4c67b6757f0a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:59.808332 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e08c4011-548c-495f-9ea3-4c67b6757f0a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.172902 Jan 28 20:26:59.809048 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 89/171] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:59 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:26:59.920539 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e5af2aef-1b25-4610-a920-7e300205d473 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:26:59.930754 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e5af2aef-1b25-4610-a920-7e300205d473 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.176599 Jan 28 20:26:59.932011 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 83/172] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:26:59 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:00.027934 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-06307388-9334-4eeb-ab97-c03434b2a110 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:00.028452 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-06307388-9334-4eeb-ab97-c03434b2a110 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:00.034746 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-06307388-9334-4eeb-ab97-c03434b2a110 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:00.035469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-06307388-9334-4eeb-ab97-c03434b2a110 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:00.036439 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-06307388-9334-4eeb-ab97-c03434b2a110 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:00.037074 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-06307388-9334-4eeb-ab97-c03434b2a110 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:00.198145 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-06307388-9334-4eeb-ab97-c03434b2a110 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:00.205979 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-06307388-9334-4eeb-ab97-c03434b2a110 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.181737 Jan 28 20:27:00.206552 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 90/173] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:00 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:00.538841 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:00.539441 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:00.546235 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:00.546675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:00.547454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:00.547880 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:00.679120 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:00.687416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:00.688902 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:00.690009 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-fb2d679b-1f3d-4473-b776-08c843b402cb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.154768 Jan 28 20:27:00.690566 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 84/174] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:27:00 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:27:00.823986 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ced22c8f-e295-45d6-b3ad-4056f70fe79a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:00.824592 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ced22c8f-e295-45d6-b3ad-4056f70fe79a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:00.830426 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ced22c8f-e295-45d6-b3ad-4056f70fe79a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:00.830873 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ced22c8f-e295-45d6-b3ad-4056f70fe79a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:00.831655 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ced22c8f-e295-45d6-b3ad-4056f70fe79a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:00.832079 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ced22c8f-e295-45d6-b3ad-4056f70fe79a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:00.947455 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-53962173-ea90-486b-9d56-cc0795504c9d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:00.948219 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-53962173-ea90-486b-9d56-cc0795504c9d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:00.954570 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-53962173-ea90-486b-9d56-cc0795504c9d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:00.955266 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-53962173-ea90-486b-9d56-cc0795504c9d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:00.956145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-53962173-ea90-486b-9d56-cc0795504c9d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:00.956795 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-53962173-ea90-486b-9d56-cc0795504c9d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:00.966362 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ced22c8f-e295-45d6-b3ad-4056f70fe79a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:00.973606 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ced22c8f-e295-45d6-b3ad-4056f70fe79a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.153109 Jan 28 20:27:00.974296 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 91/175] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:00 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:01.107357 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-53962173-ea90-486b-9d56-cc0795504c9d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:01.114496 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-53962173-ea90-486b-9d56-cc0795504c9d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.170864 Jan 28 20:27:01.115062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 85/176] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:00 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:01.222746 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-6afcbc31-069c-4e92-99f2-3289f15fc5d0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:01.223353 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-6afcbc31-069c-4e92-99f2-3289f15fc5d0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:01.229070 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6afcbc31-069c-4e92-99f2-3289f15fc5d0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:01.229518 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6afcbc31-069c-4e92-99f2-3289f15fc5d0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:01.230441 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6afcbc31-069c-4e92-99f2-3289f15fc5d0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:01.231409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6afcbc31-069c-4e92-99f2-3289f15fc5d0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:01.370257 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-6afcbc31-069c-4e92-99f2-3289f15fc5d0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:01.378169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-6afcbc31-069c-4e92-99f2-3289f15fc5d0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.159086 Jan 28 20:27:01.378833 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 92/177] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:01 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:01.707538 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:01.708447 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:01.714256 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:01.714782 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:01.716126 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:01.716673 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:01.854528 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:01.862954 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:01.864445 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:01.865599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c199733b-a261-494a-bc35-3f24729e6ea4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.161709 Jan 28 20:27:01.866127 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 86/178] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:27:01 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:27:01.993640 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2ac79bf4-243d-47cd-a9e8-478d31d62df3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:01.994350 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2ac79bf4-243d-47cd-a9e8-478d31d62df3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:02.000473 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2ac79bf4-243d-47cd-a9e8-478d31d62df3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:02.000915 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2ac79bf4-243d-47cd-a9e8-478d31d62df3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:02.001714 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2ac79bf4-243d-47cd-a9e8-478d31d62df3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:02.002212 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2ac79bf4-243d-47cd-a9e8-478d31d62df3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:02.131847 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-830c8065-c499-432a-ace0-f73ad091bc40 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:02.133036 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-830c8065-c499-432a-ace0-f73ad091bc40 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:02.139611 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-830c8065-c499-432a-ace0-f73ad091bc40 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:02.140198 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-830c8065-c499-432a-ace0-f73ad091bc40 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:02.141266 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-830c8065-c499-432a-ace0-f73ad091bc40 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:02.142012 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-830c8065-c499-432a-ace0-f73ad091bc40 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:02.156171 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2ac79bf4-243d-47cd-a9e8-478d31d62df3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:02.165862 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2ac79bf4-243d-47cd-a9e8-478d31d62df3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.177361 Jan 28 20:27:02.166929 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 93/179] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:01 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:02.295423 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-830c8065-c499-432a-ace0-f73ad091bc40 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:02.303140 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-830c8065-c499-432a-ace0-f73ad091bc40 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.175285 Jan 28 20:27:02.303640 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 87/180] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:02 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:02.395115 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7744992a-f60b-4303-b122-2a24b5feda16 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:02.395635 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7744992a-f60b-4303-b122-2a24b5feda16 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:02.401185 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7744992a-f60b-4303-b122-2a24b5feda16 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:02.401626 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7744992a-f60b-4303-b122-2a24b5feda16 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:02.402534 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7744992a-f60b-4303-b122-2a24b5feda16 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:02.402984 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7744992a-f60b-4303-b122-2a24b5feda16 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:02.536911 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7744992a-f60b-4303-b122-2a24b5feda16 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:02.553836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7744992a-f60b-4303-b122-2a24b5feda16 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.162362 Jan 28 20:27:02.554443 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 94/181] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:02 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:02.884262 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:02.884862 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:02.891138 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:02.891590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:02.892472 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:02.892808 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:03.072972 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:03.081688 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:03.083296 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:03.084572 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4b70dbc2-cc22-4677-90df-2141316fb5f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.203924 Jan 28 20:27:03.085309 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 88/182] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:27:02 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:27:03.184961 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9219bf35-0206-4615-ab9d-0b51976d43c1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:03.185579 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9219bf35-0206-4615-ab9d-0b51976d43c1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:03.191325 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9219bf35-0206-4615-ab9d-0b51976d43c1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:03.191774 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9219bf35-0206-4615-ab9d-0b51976d43c1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:03.192698 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9219bf35-0206-4615-ab9d-0b51976d43c1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:03.193133 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9219bf35-0206-4615-ab9d-0b51976d43c1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:03.320136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d48e8f24-4c42-4ed3-b0e7-a1ba9732c367 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:03.320859 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d48e8f24-4c42-4ed3-b0e7-a1ba9732c367 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:03.327684 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d48e8f24-4c42-4ed3-b0e7-a1ba9732c367 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:03.328125 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d48e8f24-4c42-4ed3-b0e7-a1ba9732c367 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:03.328914 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d48e8f24-4c42-4ed3-b0e7-a1ba9732c367 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:03.329336 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d48e8f24-4c42-4ed3-b0e7-a1ba9732c367 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:03.618587 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9219bf35-0206-4615-ab9d-0b51976d43c1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:03.622762 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d48e8f24-4c42-4ed3-b0e7-a1ba9732c367 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:03.628435 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9219bf35-0206-4615-ab9d-0b51976d43c1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.447551 Jan 28 20:27:03.629742 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 95/183] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:03 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:03.634366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c108b2fa-0340-4577-b545-0258222e61fe tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:03.635061 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c108b2fa-0340-4577-b545-0258222e61fe tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:03.641626 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c108b2fa-0340-4577-b545-0258222e61fe tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:03.642373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c108b2fa-0340-4577-b545-0258222e61fe tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:03.643386 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c108b2fa-0340-4577-b545-0258222e61fe tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:03.643617 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d48e8f24-4c42-4ed3-b0e7-a1ba9732c367 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.326725 Jan 28 20:27:03.643943 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c108b2fa-0340-4577-b545-0258222e61fe tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:03.644645 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 89/184] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:03 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:03.799948 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c108b2fa-0340-4577-b545-0258222e61fe tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:03.809868 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c108b2fa-0340-4577-b545-0258222e61fe tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.178340 Jan 28 20:27:03.810969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 96/185] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:03 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:04.105830 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:04.106546 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:04.112737 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:04.113168 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:04.113981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:04.114416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:04.259776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:04.268797 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:04.270552 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:04.271860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9f091152-23b0-4ada-aeb1-eac0827dc8c9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.172700 Jan 28 20:27:04.272425 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 90/186] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:27:04 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:27:04.647968 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-61431422-8c20-4e85-aa0c-4242a6230379 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:04.648659 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-61431422-8c20-4e85-aa0c-4242a6230379 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:04.655853 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61431422-8c20-4e85-aa0c-4242a6230379 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:04.656652 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61431422-8c20-4e85-aa0c-4242a6230379 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:04.657501 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61431422-8c20-4e85-aa0c-4242a6230379 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:04.657972 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61431422-8c20-4e85-aa0c-4242a6230379 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:04.671146 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c3bc29ba-58d4-45cc-a46d-d55eab57d8c7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:04.671849 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c3bc29ba-58d4-45cc-a46d-d55eab57d8c7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:04.686746 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3bc29ba-58d4-45cc-a46d-d55eab57d8c7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:04.687253 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3bc29ba-58d4-45cc-a46d-d55eab57d8c7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:04.688063 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3bc29ba-58d4-45cc-a46d-d55eab57d8c7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:04.688499 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3bc29ba-58d4-45cc-a46d-d55eab57d8c7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:05.006624 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c3bc29ba-58d4-45cc-a46d-d55eab57d8c7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:05.011259 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-61431422-8c20-4e85-aa0c-4242a6230379 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:05.014623 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c3bc29ba-58d4-45cc-a46d-d55eab57d8c7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1321 microversion: 2.1 time: 0.356409 Jan 28 20:27:05.015264 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 91/187] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:04 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:05.019723 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-412cbaef-eb34-41ca-9344-03063bc6ad67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:05.020321 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-412cbaef-eb34-41ca-9344-03063bc6ad67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:05.027095 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-412cbaef-eb34-41ca-9344-03063bc6ad67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:05.027679 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-412cbaef-eb34-41ca-9344-03063bc6ad67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:05.029010 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-412cbaef-eb34-41ca-9344-03063bc6ad67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:05.029483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-412cbaef-eb34-41ca-9344-03063bc6ad67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:05.029615 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-61431422-8c20-4e85-aa0c-4242a6230379 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.386530 Jan 28 20:27:05.030376 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 97/188] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:04 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:05.231378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-412cbaef-eb34-41ca-9344-03063bc6ad67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:05.239741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-412cbaef-eb34-41ca-9344-03063bc6ad67 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.223341 Jan 28 20:27:05.240615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 92/189] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:05 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:05.289463 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:05.290521 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:05.299305 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:05.299749 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:05.302521 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:05.302998 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:05.474163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:05.484427 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:05.486634 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:05.488953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7c062c74-397f-4d54-8e5c-495363cbea37 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.203094 Jan 28 20:27:05.489748 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 98/190] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:27:05 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:27:06.031769 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-46660b50-e004-427a-93e6-e59006aff861 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:06.032306 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-46660b50-e004-427a-93e6-e59006aff861 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:06.038367 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46660b50-e004-427a-93e6-e59006aff861 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.038815 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46660b50-e004-427a-93e6-e59006aff861 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.039597 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46660b50-e004-427a-93e6-e59006aff861 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.040030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46660b50-e004-427a-93e6-e59006aff861 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.050175 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3ec38aa2-dd49-4c3b-91b7-cbe4d557338a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:06.050777 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3ec38aa2-dd49-4c3b-91b7-cbe4d557338a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:06.056750 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ec38aa2-dd49-4c3b-91b7-cbe4d557338a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.057292 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ec38aa2-dd49-4c3b-91b7-cbe4d557338a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.058165 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ec38aa2-dd49-4c3b-91b7-cbe4d557338a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.058632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ec38aa2-dd49-4c3b-91b7-cbe4d557338a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.240754 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-46660b50-e004-427a-93e6-e59006aff861 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:06.243880 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3ec38aa2-dd49-4c3b-91b7-cbe4d557338a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:06.249865 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-46660b50-e004-427a-93e6-e59006aff861 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1514 microversion: 2.1 time: 0.221952 Jan 28 20:27:06.251177 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 93/191] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:06 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:06.251643 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3ec38aa2-dd49-4c3b-91b7-cbe4d557338a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.204678 Jan 28 20:27:06.256117 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-96489afb-7991-4e01-8971-c6ce0b8ae437 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:06.256750 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-96489afb-7991-4e01-8971-c6ce0b8ae437 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:06.259675 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 99/192] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:06 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:06.263681 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-96489afb-7991-4e01-8971-c6ce0b8ae437 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.264360 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-96489afb-7991-4e01-8971-c6ce0b8ae437 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.265254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-96489afb-7991-4e01-8971-c6ce0b8ae437 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.265685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-96489afb-7991-4e01-8971-c6ce0b8ae437 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.266659 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e195b0c2-f5fb-450f-8efa-724868699267 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:06.267660 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e195b0c2-f5fb-450f-8efa-724868699267 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:06.273386 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e195b0c2-f5fb-450f-8efa-724868699267 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.273828 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e195b0c2-f5fb-450f-8efa-724868699267 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.274623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e195b0c2-f5fb-450f-8efa-724868699267 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.275046 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e195b0c2-f5fb-450f-8efa-724868699267 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.337122 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-e195b0c2-f5fb-450f-8efa-724868699267 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lazy-loading 'flavor' on Instance uuid 9f87e725-240c-4b00-836b-4e5e8a4f0916 {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:27:06.400262 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-96489afb-7991-4e01-8971-c6ce0b8ae437 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:06.408615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-96489afb-7991-4e01-8971-c6ce0b8ae437 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.155922 Jan 28 20:27:06.409191 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 94/193] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:06 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:06.452324 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e195b0c2-f5fb-450f-8efa-724868699267 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "POST /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916/action" status: 200 len: 32 microversion: 2.1 time: 0.189325 Jan 28 20:27:06.453001 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 100/194] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:27:06 2022] POST /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 20:27:06.461641 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ad15710a-311b-402b-9162-1af782db0015 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:06.462271 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ad15710a-311b-402b-9162-1af782db0015 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:06.468886 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ad15710a-311b-402b-9162-1af782db0015 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.469354 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ad15710a-311b-402b-9162-1af782db0015 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.470160 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ad15710a-311b-402b-9162-1af782db0015 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.470592 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ad15710a-311b-402b-9162-1af782db0015 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.507446 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:06.508135 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:06.514588 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.515035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.515810 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:06.516238 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:06.633572 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ad15710a-311b-402b-9162-1af782db0015 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:06.641498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ad15710a-311b-402b-9162-1af782db0015 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.183383 Jan 28 20:27:06.642129 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 95/195] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:06 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:06.692294 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:06.700668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:06.702201 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:06.703298 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3cd377f9-8369-47c7-a8be-d84715d8372d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.199788 Jan 28 20:27:06.703862 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 101/196] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:27:06 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:27:07.268136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-df9bdbaa-598a-4487-b5ed-ccb62c728752 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:07.269099 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-df9bdbaa-598a-4487-b5ed-ccb62c728752 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:07.274932 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-df9bdbaa-598a-4487-b5ed-ccb62c728752 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:07.275380 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-df9bdbaa-598a-4487-b5ed-ccb62c728752 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:07.276167 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-df9bdbaa-598a-4487-b5ed-ccb62c728752 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:07.276599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-df9bdbaa-598a-4487-b5ed-ccb62c728752 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:07.429271 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-df9bdbaa-598a-4487-b5ed-ccb62c728752 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:07.430252 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-348a3f34-9c9c-41f3-8ef4-9862fe7425af tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:07.431004 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-348a3f34-9c9c-41f3-8ef4-9862fe7425af tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:07.441161 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-348a3f34-9c9c-41f3-8ef4-9862fe7425af tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:07.441797 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-348a3f34-9c9c-41f3-8ef4-9862fe7425af tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:07.442850 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-348a3f34-9c9c-41f3-8ef4-9862fe7425af tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:07.443473 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-348a3f34-9c9c-41f3-8ef4-9862fe7425af tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:07.444557 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-df9bdbaa-598a-4487-b5ed-ccb62c728752 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.180007 Jan 28 20:27:07.450710 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 96/197] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:07 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:07.601964 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-348a3f34-9c9c-41f3-8ef4-9862fe7425af tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:07.611140 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-348a3f34-9c9c-41f3-8ef4-9862fe7425af tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1315 microversion: 2.1 time: 0.190392 Jan 28 20:27:07.611739 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 102/198] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:07 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:07.658786 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e155a505-63e1-4eb1-b9e1-e7af0ec12902 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:07.659403 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e155a505-63e1-4eb1-b9e1-e7af0ec12902 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:07.665430 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e155a505-63e1-4eb1-b9e1-e7af0ec12902 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:07.665904 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e155a505-63e1-4eb1-b9e1-e7af0ec12902 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:07.666706 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e155a505-63e1-4eb1-b9e1-e7af0ec12902 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:07.667137 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e155a505-63e1-4eb1-b9e1-e7af0ec12902 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:07.720680 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:07.721385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:07.727742 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:07.728179 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:07.728976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:07.729404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:07.833396 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e155a505-63e1-4eb1-b9e1-e7af0ec12902 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:07.840819 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e155a505-63e1-4eb1-b9e1-e7af0ec12902 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.186290 Jan 28 20:27:07.841393 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 97/199] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:07 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:07.901796 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:07.915575 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:07.917982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:07.920057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-72f03ba0-3e01-42d5-b99b-e8e50b3eb7e1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1407 microversion: 2.20 time: 0.203417 Jan 28 20:27:07.921334 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 103/200] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:27:07 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:27:08.467095 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e775b450-11f3-47c6-bfdc-8d6548515c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:08.467670 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e775b450-11f3-47c6-bfdc-8d6548515c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:08.473429 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e775b450-11f3-47c6-bfdc-8d6548515c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:08.473897 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e775b450-11f3-47c6-bfdc-8d6548515c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:08.474677 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e775b450-11f3-47c6-bfdc-8d6548515c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:08.475108 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e775b450-11f3-47c6-bfdc-8d6548515c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:08.618408 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e775b450-11f3-47c6-bfdc-8d6548515c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:08.627302 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e775b450-11f3-47c6-bfdc-8d6548515c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1317 microversion: 2.1 time: 0.163999 Jan 28 20:27:08.628594 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 98/201] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:08 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:08.628701 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-fb782fec-bf5a-42fa-9d65-8b718bbd1be4 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:08.629425 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-fb782fec-bf5a-42fa-9d65-8b718bbd1be4 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:08.635442 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fb782fec-bf5a-42fa-9d65-8b718bbd1be4 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:08.635886 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fb782fec-bf5a-42fa-9d65-8b718bbd1be4 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:08.636661 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fb782fec-bf5a-42fa-9d65-8b718bbd1be4 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:08.637668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fb782fec-bf5a-42fa-9d65-8b718bbd1be4 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:08.858291 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2f30fe3c-07f0-4ee2-ae54-725e6cd0e478 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:08.858900 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2f30fe3c-07f0-4ee2-ae54-725e6cd0e478 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:08.876417 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2f30fe3c-07f0-4ee2-ae54-725e6cd0e478 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:08.877141 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2f30fe3c-07f0-4ee2-ae54-725e6cd0e478 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:08.878020 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2f30fe3c-07f0-4ee2-ae54-725e6cd0e478 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:08.879623 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2f30fe3c-07f0-4ee2-ae54-725e6cd0e478 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:08.957540 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-fb782fec-bf5a-42fa-9d65-8b718bbd1be4 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:08.967255 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-fb782fec-bf5a-42fa-9d65-8b718bbd1be4 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1502 microversion: 2.1 time: 0.341134 Jan 28 20:27:08.970402 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 104/202] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:08 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1502 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:08.982178 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:08.984699 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:08.997059 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:08.998153 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:08.999545 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:09.000128 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:09.130397 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2f30fe3c-07f0-4ee2-ae54-725e6cd0e478 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:09.139780 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2f30fe3c-07f0-4ee2-ae54-725e6cd0e478 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.284566 Jan 28 20:27:09.140507 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 99/203] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:08 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:09.206896 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:09.217312 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:09.218859 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:09.220941 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1875894f-d7ab-4456-a6c4-d9c45dad2926 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1599 microversion: 2.20 time: 0.249298 Jan 28 20:27:09.222776 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 105/204] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:27:08 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1599 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:27:09.243667 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d39effdd-658b-4097-a071-f31bf797fa75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:09.244386 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d39effdd-658b-4097-a071-f31bf797fa75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:09.251429 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d39effdd-658b-4097-a071-f31bf797fa75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:09.251889 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d39effdd-658b-4097-a071-f31bf797fa75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:09.252786 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d39effdd-658b-4097-a071-f31bf797fa75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:09.253222 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d39effdd-658b-4097-a071-f31bf797fa75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:09.439327 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d39effdd-658b-4097-a071-f31bf797fa75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.199539 Jan 28 20:27:09.439932 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 100/205] 10.222.0.59 () {60 vars in 1315 bytes} [Fri Jan 28 20:27:09 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:27:09.644243 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-104ab24d-f9aa-4941-a967-0342a7cebe47 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:09.644858 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-104ab24d-f9aa-4941-a967-0342a7cebe47 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:09.650677 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-104ab24d-f9aa-4941-a967-0342a7cebe47 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:09.651126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-104ab24d-f9aa-4941-a967-0342a7cebe47 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:09.651933 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-104ab24d-f9aa-4941-a967-0342a7cebe47 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:09.652365 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-104ab24d-f9aa-4941-a967-0342a7cebe47 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:10.052039 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-104ab24d-f9aa-4941-a967-0342a7cebe47 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:10.060076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-104ab24d-f9aa-4941-a967-0342a7cebe47 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1507 microversion: 2.1 time: 0.419431 Jan 28 20:27:10.060750 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 106/206] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:09 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:10.165907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4f50f941-f935-4ca6-8edd-0f2425a1111a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:10.167483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4f50f941-f935-4ca6-8edd-0f2425a1111a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:10.176037 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f50f941-f935-4ca6-8edd-0f2425a1111a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:10.176948 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f50f941-f935-4ca6-8edd-0f2425a1111a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:10.177992 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f50f941-f935-4ca6-8edd-0f2425a1111a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:10.178481 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f50f941-f935-4ca6-8edd-0f2425a1111a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:10.569457 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-141551dd-c1b4-43af-a60e-482bf03f2021 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bdc72d8-d9db-46a4-8d13-1b907c5358ed"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:10.572236 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-141551dd-c1b4-43af-a60e-482bf03f2021 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:10.582156 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-141551dd-c1b4-43af-a60e-482bf03f2021 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:10.584811 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-141551dd-c1b4-43af-a60e-482bf03f2021 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:10.587096 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-141551dd-c1b4-43af-a60e-482bf03f2021 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:10.587582 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-141551dd-c1b4-43af-a60e-482bf03f2021 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:10.627794 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4f50f941-f935-4ca6-8edd-0f2425a1111a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:10.635250 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4f50f941-f935-4ca6-8edd-0f2425a1111a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.482044 Jan 28 20:27:10.646640 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 101/207] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:10 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:11.064320 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-141551dd-c1b4-43af-a60e-482bf03f2021 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "POST /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500531 Jan 28 20:27:11.065324 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 107/208] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:27:10 2022] POST /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:27:11.415316 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-606322fe-c435-4649-bb64-98799d1838f6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:11.420958 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-13a381e2-a5fe-4876-b4db-06f0b7f598dd req-0c862f65-8ec3-492d-864b-72713cb2dee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd446032-56d9-4e84-abd4-85bc3acbc24b", "tag": "37507c9d-22d6-4b55-b7be-87e04e27d5d1"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:11.423670 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-606322fe-c435-4649-bb64-98799d1838f6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:11.425019 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:27:11.425019 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:27:11.448554 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-606322fe-c435-4649-bb64-98799d1838f6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:11.449305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-606322fe-c435-4649-bb64-98799d1838f6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:11.450332 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-606322fe-c435-4649-bb64-98799d1838f6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:11.452775 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-13a381e2-a5fe-4876-b4db-06f0b7f598dd req-0c862f65-8ec3-492d-864b-72713cb2dee7 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:11.453634 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-606322fe-c435-4649-bb64-98799d1838f6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:11.459196 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-13a381e2-a5fe-4876-b4db-06f0b7f598dd req-0c862f65-8ec3-492d-864b-72713cb2dee7 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:11.485674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-13a381e2-a5fe-4876-b4db-06f0b7f598dd req-0c862f65-8ec3-492d-864b-72713cb2dee7 service nova] Creating event network-changed:37507c9d-22d6-4b55-b7be-87e04e27d5d1 for instance dd446032-56d9-4e84-abd4-85bc3acbc24b on hv-cinder-82635 Jan 28 20:27:11.516116 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-13a381e2-a5fe-4876-b4db-06f0b7f598dd req-0c862f65-8ec3-492d-864b-72713cb2dee7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107577 Jan 28 20:27:11.518616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 108/209] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:27:11.528752 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-606322fe-c435-4649-bb64-98799d1838f6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b/ips" status: 200 len: 112 microversion: 2.20 time: 0.122567 Jan 28 20:27:11.529550 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 102/210] 10.222.0.59 () {60 vars in 1288 bytes} [Fri Jan 28 20:27:11 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b/ips => generated 112 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:27:11.570215 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4ba26599-4fb5-405f-8668-86c6241dcbf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "482afad1-3bd9-4b5c-8ac3-986bc5de338a"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:11.573213 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4ba26599-4fb5-405f-8668-86c6241dcbf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:11.590658 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ba26599-4fb5-405f-8668-86c6241dcbf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:11.593964 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ba26599-4fb5-405f-8668-86c6241dcbf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:11.596090 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ba26599-4fb5-405f-8668-86c6241dcbf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:11.599849 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ba26599-4fb5-405f-8668-86c6241dcbf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:11.655378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-12d18981-bcb3-4740-ae0f-c385b665a78c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:11.656140 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-12d18981-bcb3-4740-ae0f-c385b665a78c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:11.664745 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-12d18981-bcb3-4740-ae0f-c385b665a78c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:11.666415 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-12d18981-bcb3-4740-ae0f-c385b665a78c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:11.668303 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-12d18981-bcb3-4740-ae0f-c385b665a78c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:11.669112 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-12d18981-bcb3-4740-ae0f-c385b665a78c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:11.922771 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-12d18981-bcb3-4740-ae0f-c385b665a78c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:11.939489 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-12d18981-bcb3-4740-ae0f-c385b665a78c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.288671 Jan 28 20:27:11.941633 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 103/211] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:11 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:12.721404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4ba26599-4fb5-405f-8668-86c6241dcbf5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "POST /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.158192 Jan 28 20:27:12.722105 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 109/212] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:27:11 2022] POST /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments => generated 194 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:27:12.956321 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e50d8fcc-8f6e-4f80-8f68-c27a61120d32 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:12.956928 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e50d8fcc-8f6e-4f80-8f68-c27a61120d32 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:12.964124 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e50d8fcc-8f6e-4f80-8f68-c27a61120d32 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:12.964636 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e50d8fcc-8f6e-4f80-8f68-c27a61120d32 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:12.966306 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e50d8fcc-8f6e-4f80-8f68-c27a61120d32 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:12.966961 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e50d8fcc-8f6e-4f80-8f68-c27a61120d32 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:13.144947 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e50d8fcc-8f6e-4f80-8f68-c27a61120d32 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:13.154202 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e50d8fcc-8f6e-4f80-8f68-c27a61120d32 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.201266 Jan 28 20:27:13.155610 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 104/213] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:12 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:14.173135 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d225d5b1-87dd-4a46-b66f-441bbde0052e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:14.174254 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d225d5b1-87dd-4a46-b66f-441bbde0052e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:14.184424 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d225d5b1-87dd-4a46-b66f-441bbde0052e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:14.185383 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d225d5b1-87dd-4a46-b66f-441bbde0052e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:14.186406 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d225d5b1-87dd-4a46-b66f-441bbde0052e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:14.187725 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d225d5b1-87dd-4a46-b66f-441bbde0052e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:14.363841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d225d5b1-87dd-4a46-b66f-441bbde0052e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:14.377260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d225d5b1-87dd-4a46-b66f-441bbde0052e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.208820 Jan 28 20:27:14.379421 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 110/214] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:14 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:15.397145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2dda4fc0-09c5-4a9b-92a5-782d658e4c8c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:15.398043 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2dda4fc0-09c5-4a9b-92a5-782d658e4c8c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:15.405776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2dda4fc0-09c5-4a9b-92a5-782d658e4c8c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:15.406478 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2dda4fc0-09c5-4a9b-92a5-782d658e4c8c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:15.407688 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2dda4fc0-09c5-4a9b-92a5-782d658e4c8c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:15.408021 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2dda4fc0-09c5-4a9b-92a5-782d658e4c8c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:15.648074 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2dda4fc0-09c5-4a9b-92a5-782d658e4c8c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:15.656484 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2dda4fc0-09c5-4a9b-92a5-782d658e4c8c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.264616 Jan 28 20:27:15.657119 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 105/215] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:15 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:16.674377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-534b362b-fab2-40ae-a9b7-af3b0ae71ce6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:16.674985 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-534b362b-fab2-40ae-a9b7-af3b0ae71ce6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:16.682369 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-534b362b-fab2-40ae-a9b7-af3b0ae71ce6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:16.682806 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-534b362b-fab2-40ae-a9b7-af3b0ae71ce6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:16.684155 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-534b362b-fab2-40ae-a9b7-af3b0ae71ce6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:16.684744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-534b362b-fab2-40ae-a9b7-af3b0ae71ce6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:16.888377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-534b362b-fab2-40ae-a9b7-af3b0ae71ce6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:16.897489 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-534b362b-fab2-40ae-a9b7-af3b0ae71ce6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.227314 Jan 28 20:27:16.898469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 111/216] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:16 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:17.914437 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e48c231e-7f26-4cb7-9b57-258ef236c2b8 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:17.915602 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e48c231e-7f26-4cb7-9b57-258ef236c2b8 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:17.921329 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e48c231e-7f26-4cb7-9b57-258ef236c2b8 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:17.922044 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e48c231e-7f26-4cb7-9b57-258ef236c2b8 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:17.923058 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e48c231e-7f26-4cb7-9b57-258ef236c2b8 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:17.923647 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e48c231e-7f26-4cb7-9b57-258ef236c2b8 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:18.059048 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-85183628", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "networks": [{"uuid": "90b7b458-4b47-48b0-9af1-84b27f2d7b01"}]}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:18.127129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] validate_networks() for [('90b7b458-4b47-48b0-9af1-84b27f2d7b01', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:27:18.412815 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e48c231e-7f26-4cb7-9b57-258ef236c2b8 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:18.420589 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e48c231e-7f26-4cb7-9b57-258ef236c2b8 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.510106 Jan 28 20:27:18.421164 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 106/217] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:17 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:18.654862 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:27:18.655658 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:27:18.660219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:27:18.660219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:27:18.660219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:27:18.677782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:18.678247 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:18.679039 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:18.679469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:18.700886 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Getting quotas for project 78a5e26db5b844c4b585a7441fefd731. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:27:18.705589 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Getting quotas for user 912a6a973222441788982735658fabcb and project 78a5e26db5b844c4b585a7441fefd731. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:27:18.718641 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:27:18.720957 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:27:18.766516 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-de4cfd86-6068-4a83-9020-eef19687b92d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711650 Jan 28 20:27:18.767179 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 112/218] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:27:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 20:27:18.777685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-85ab047c-05c6-4524-be9e-29d23b8c50b4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:18.778760 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-85ab047c-05c6-4524-be9e-29d23b8c50b4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:18.858511 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-85ab047c-05c6-4524-be9e-29d23b8c50b4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:18.882198 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-85ab047c-05c6-4524-be9e-29d23b8c50b4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1217 microversion: 2.1 time: 0.108773 Jan 28 20:27:18.887717 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 107/219] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:18 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:19.437624 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-07cb9d83-640f-468f-98ec-333991fb1043 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:19.438367 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-07cb9d83-640f-468f-98ec-333991fb1043 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:19.447720 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-07cb9d83-640f-468f-98ec-333991fb1043 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:19.448423 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-07cb9d83-640f-468f-98ec-333991fb1043 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:19.449484 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-07cb9d83-640f-468f-98ec-333991fb1043 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:19.449946 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-07cb9d83-640f-468f-98ec-333991fb1043 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:19.595836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-07cb9d83-640f-468f-98ec-333991fb1043 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:19.604005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-07cb9d83-640f-468f-98ec-333991fb1043 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.170543 Jan 28 20:27:19.604586 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 113/220] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:19 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:19.903359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2892f1f1-d1b8-4675-ac12-22f89ff3dc32 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:19.904037 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2892f1f1-d1b8-4675-ac12-22f89ff3dc32 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:19.910412 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2892f1f1-d1b8-4675-ac12-22f89ff3dc32 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:19.910853 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2892f1f1-d1b8-4675-ac12-22f89ff3dc32 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:19.911619 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2892f1f1-d1b8-4675-ac12-22f89ff3dc32 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:19.912045 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2892f1f1-d1b8-4675-ac12-22f89ff3dc32 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:19.975295 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2892f1f1-d1b8-4675-ac12-22f89ff3dc32 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:19.983609 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2892f1f1-d1b8-4675-ac12-22f89ff3dc32 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1269 microversion: 2.1 time: 0.083924 Jan 28 20:27:19.984277 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 108/221] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:19 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:20.620896 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-db0681ee-e7ca-48f3-8259-8723832b8460 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:20.622458 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-db0681ee-e7ca-48f3-8259-8723832b8460 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:20.631978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-db0681ee-e7ca-48f3-8259-8723832b8460 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:20.632427 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-db0681ee-e7ca-48f3-8259-8723832b8460 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:20.633209 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-db0681ee-e7ca-48f3-8259-8723832b8460 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:20.633642 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-db0681ee-e7ca-48f3-8259-8723832b8460 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:20.794266 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-db0681ee-e7ca-48f3-8259-8723832b8460 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:20.802989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-db0681ee-e7ca-48f3-8259-8723832b8460 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.185776 Jan 28 20:27:20.805145 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 114/222] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:20 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:21.007070 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8b0b9d5d-bfb5-4cbf-8a59-5fa846040fa7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:21.008359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8b0b9d5d-bfb5-4cbf-8a59-5fa846040fa7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:21.017387 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8b0b9d5d-bfb5-4cbf-8a59-5fa846040fa7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:21.018016 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8b0b9d5d-bfb5-4cbf-8a59-5fa846040fa7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:21.019371 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8b0b9d5d-bfb5-4cbf-8a59-5fa846040fa7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:21.019809 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8b0b9d5d-bfb5-4cbf-8a59-5fa846040fa7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:21.215532 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8b0b9d5d-bfb5-4cbf-8a59-5fa846040fa7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:21.223163 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8b0b9d5d-bfb5-4cbf-8a59-5fa846040fa7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.219910 Jan 28 20:27:21.223860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 109/223] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:21 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:21.823557 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-36a0763d-ccde-4539-9c38-52ec85c2a97b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:21.826259 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-36a0763d-ccde-4539-9c38-52ec85c2a97b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:21.849449 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-36a0763d-ccde-4539-9c38-52ec85c2a97b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:21.850205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-36a0763d-ccde-4539-9c38-52ec85c2a97b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:21.851835 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-36a0763d-ccde-4539-9c38-52ec85c2a97b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:21.852649 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-36a0763d-ccde-4539-9c38-52ec85c2a97b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:22.030904 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-523c09f1-8b87-4dec-baca-5e4a3c2dbbe7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:22.031970 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-523c09f1-8b87-4dec-baca-5e4a3c2dbbe7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:22.038399 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-523c09f1-8b87-4dec-baca-5e4a3c2dbbe7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:22.039037 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-523c09f1-8b87-4dec-baca-5e4a3c2dbbe7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:22.039991 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-523c09f1-8b87-4dec-baca-5e4a3c2dbbe7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:22.040563 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-523c09f1-8b87-4dec-baca-5e4a3c2dbbe7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:22.070650 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-523c09f1-8b87-4dec-baca-5e4a3c2dbbe7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:27:22.092930 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-36a0763d-ccde-4539-9c38-52ec85c2a97b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:22.101814 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-36a0763d-ccde-4539-9c38-52ec85c2a97b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.284060 Jan 28 20:27:22.102536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 115/224] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:21 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:22.143048 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-a2e45ea0-3d64-44da-9270-3f6703d01ed0 req-ea7e7138-18c6-4e3e-891e-65c9718ded19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dd8af5-ad5a-461a-b185-54130ae59903", "tag": "68ef1535-e8b0-430f-a7e8-8b7631bf4fcc"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:22.147012 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:27:22.147012 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:27:22.166319 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-a2e45ea0-3d64-44da-9270-3f6703d01ed0 req-ea7e7138-18c6-4e3e-891e-65c9718ded19 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:22.166968 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-a2e45ea0-3d64-44da-9270-3f6703d01ed0 req-ea7e7138-18c6-4e3e-891e-65c9718ded19 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:22.181040 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-a2e45ea0-3d64-44da-9270-3f6703d01ed0 req-ea7e7138-18c6-4e3e-891e-65c9718ded19 service nova] Creating event network-changed:68ef1535-e8b0-430f-a7e8-8b7631bf4fcc for instance 08dd8af5-ad5a-461a-b185-54130ae59903 on hv-cinder-82635 Jan 28 20:27:22.192795 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-a2e45ea0-3d64-44da-9270-3f6703d01ed0 req-ea7e7138-18c6-4e3e-891e-65c9718ded19 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060288 Jan 28 20:27:22.193732 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 116/225] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:27:22.215768 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-523c09f1-8b87-4dec-baca-5e4a3c2dbbe7 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "DELETE /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 204 len: 0 microversion: 2.1 time: 0.188634 Jan 28 20:27:22.225200 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-225df541-621f-41ae-b5ec-6182074ab2f5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:22.226011 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-225df541-621f-41ae-b5ec-6182074ab2f5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:22.230471 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 110/226] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:27:22 2022] DELETE /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 20:27:22.232324 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-225df541-621f-41ae-b5ec-6182074ab2f5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:22.232915 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-225df541-621f-41ae-b5ec-6182074ab2f5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:22.233956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-225df541-621f-41ae-b5ec-6182074ab2f5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:22.234269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-225df541-621f-41ae-b5ec-6182074ab2f5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:22.242538 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c7ef1886-77a3-4c16-818c-f2ce44395f72 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:22.244073 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c7ef1886-77a3-4c16-818c-f2ce44395f72 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:22.251309 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7ef1886-77a3-4c16-818c-f2ce44395f72 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:22.251956 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7ef1886-77a3-4c16-818c-f2ce44395f72 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:22.252882 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7ef1886-77a3-4c16-818c-f2ce44395f72 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:22.253307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7ef1886-77a3-4c16-818c-f2ce44395f72 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:22.499897 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c7ef1886-77a3-4c16-818c-f2ce44395f72 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:22.507533 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c7ef1886-77a3-4c16-818c-f2ce44395f72 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.270121 Jan 28 20:27:22.511013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-225df541-621f-41ae-b5ec-6182074ab2f5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:22.519701 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-225df541-621f-41ae-b5ec-6182074ab2f5 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1554 microversion: 2.1 time: 0.298607 Jan 28 20:27:22.520335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 111/227] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:22 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:22.520742 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 117/228] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:22 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1554 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:23.118257 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e5b91f20-3817-40ac-81c7-a1e48ba9f93b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:23.119000 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e5b91f20-3817-40ac-81c7-a1e48ba9f93b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:23.124865 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e5b91f20-3817-40ac-81c7-a1e48ba9f93b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:23.125300 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e5b91f20-3817-40ac-81c7-a1e48ba9f93b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:23.126162 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e5b91f20-3817-40ac-81c7-a1e48ba9f93b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:23.126585 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e5b91f20-3817-40ac-81c7-a1e48ba9f93b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:23.265223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e5b91f20-3817-40ac-81c7-a1e48ba9f93b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:23.272926 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e5b91f20-3817-40ac-81c7-a1e48ba9f93b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.158247 Jan 28 20:27:23.273500 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 112/229] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:23 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:23.532259 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-256e4a6b-b26c-42ad-92ae-8c41cd92cbf9 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:23.537325 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-256e4a6b-b26c-42ad-92ae-8c41cd92cbf9 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:23.538904 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2bb9fec4-3f8d-4973-bf5d-0307dbaa068a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:23.539741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2bb9fec4-3f8d-4973-bf5d-0307dbaa068a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:23.541417 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-256e4a6b-b26c-42ad-92ae-8c41cd92cbf9 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:23.541862 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-256e4a6b-b26c-42ad-92ae-8c41cd92cbf9 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:23.542673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-256e4a6b-b26c-42ad-92ae-8c41cd92cbf9 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:23.543169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-256e4a6b-b26c-42ad-92ae-8c41cd92cbf9 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:23.546307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bb9fec4-3f8d-4973-bf5d-0307dbaa068a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:23.546857 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bb9fec4-3f8d-4973-bf5d-0307dbaa068a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:23.547727 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bb9fec4-3f8d-4973-bf5d-0307dbaa068a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:23.548258 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bb9fec4-3f8d-4973-bf5d-0307dbaa068a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:23.743448 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-256e4a6b-b26c-42ad-92ae-8c41cd92cbf9 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:23.749502 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2bb9fec4-3f8d-4973-bf5d-0307dbaa068a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:23.751486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-256e4a6b-b26c-42ad-92ae-8c41cd92cbf9 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.223130 Jan 28 20:27:23.767775 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2bb9fec4-3f8d-4973-bf5d-0307dbaa068a tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1554 microversion: 2.1 time: 0.224390 Jan 28 20:27:23.767775 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 113/230] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:23 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:23.771544 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 118/231] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:23 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:24.290330 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-39a05383-f492-47ad-9957-1213688e07ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:24.290932 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-39a05383-f492-47ad-9957-1213688e07ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:24.297177 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39a05383-f492-47ad-9957-1213688e07ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:24.297631 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39a05383-f492-47ad-9957-1213688e07ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:24.298463 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39a05383-f492-47ad-9957-1213688e07ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:24.298898 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39a05383-f492-47ad-9957-1213688e07ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:24.447971 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-39a05383-f492-47ad-9957-1213688e07ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:24.455335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-39a05383-f492-47ad-9957-1213688e07ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.168619 Jan 28 20:27:24.455907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 114/232] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:24 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:24.780837 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1db8bd01-6530-4798-b036-e46edd6a2780 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:24.781959 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1db8bd01-6530-4798-b036-e46edd6a2780 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:24.782367 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c84e0355-e6ca-4a1b-845d-9094b173d11e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:24.782990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c84e0355-e6ca-4a1b-845d-9094b173d11e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:24.788307 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1db8bd01-6530-4798-b036-e46edd6a2780 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:24.788929 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1db8bd01-6530-4798-b036-e46edd6a2780 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:24.789263 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c84e0355-e6ca-4a1b-845d-9094b173d11e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:24.789704 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c84e0355-e6ca-4a1b-845d-9094b173d11e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:24.790242 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1db8bd01-6530-4798-b036-e46edd6a2780 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:24.790679 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1db8bd01-6530-4798-b036-e46edd6a2780 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:24.790788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c84e0355-e6ca-4a1b-845d-9094b173d11e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:24.791128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c84e0355-e6ca-4a1b-845d-9094b173d11e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:25.001039 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1db8bd01-6530-4798-b036-e46edd6a2780 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:25.008646 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1db8bd01-6530-4798-b036-e46edd6a2780 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.232642 Jan 28 20:27:25.012521 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c84e0355-e6ca-4a1b-845d-9094b173d11e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:25.015619 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 119/233] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:24 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:25.020333 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c84e0355-e6ca-4a1b-845d-9094b173d11e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1554 microversion: 2.1 time: 0.243890 Jan 28 20:27:25.020937 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 115/234] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:24 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:25.471853 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ebfd7d50-6793-4931-904c-c6275da1604d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:25.472473 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ebfd7d50-6793-4931-904c-c6275da1604d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:25.478202 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ebfd7d50-6793-4931-904c-c6275da1604d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:25.478860 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ebfd7d50-6793-4931-904c-c6275da1604d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:25.479830 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ebfd7d50-6793-4931-904c-c6275da1604d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:25.480163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ebfd7d50-6793-4931-904c-c6275da1604d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:25.622695 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ebfd7d50-6793-4931-904c-c6275da1604d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:25.629814 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ebfd7d50-6793-4931-904c-c6275da1604d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.161646 Jan 28 20:27:25.630413 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 120/235] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:25 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:26.025592 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a563c898-31ad-4639-8329-b0d927182943 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:26.026254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a563c898-31ad-4639-8329-b0d927182943 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:26.038950 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a563c898-31ad-4639-8329-b0d927182943 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:26.039311 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a563c898-31ad-4639-8329-b0d927182943 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:26.040136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a563c898-31ad-4639-8329-b0d927182943 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:26.040836 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a563c898-31ad-4639-8329-b0d927182943 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:26.041586 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-eb7cbc13-1656-47e5-a3d2-546e650bd9e6 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:26.042230 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-eb7cbc13-1656-47e5-a3d2-546e650bd9e6 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:26.050543 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eb7cbc13-1656-47e5-a3d2-546e650bd9e6 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:26.050986 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eb7cbc13-1656-47e5-a3d2-546e650bd9e6 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:26.051770 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eb7cbc13-1656-47e5-a3d2-546e650bd9e6 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:26.052197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eb7cbc13-1656-47e5-a3d2-546e650bd9e6 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:26.245610 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a563c898-31ad-4639-8329-b0d927182943 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:26.249225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-eb7cbc13-1656-47e5-a3d2-546e650bd9e6 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:26.253942 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a563c898-31ad-4639-8329-b0d927182943 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.232450 Jan 28 20:27:26.254501 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 116/236] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:26 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:26.257016 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-eb7cbc13-1656-47e5-a3d2-546e650bd9e6 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1554 microversion: 2.1 time: 0.219186 Jan 28 20:27:26.257738 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 121/237] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:26 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:26.649498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-aa5d2911-ded3-46c6-bf74-d999f40567d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:26.650476 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-aa5d2911-ded3-46c6-bf74-d999f40567d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:26.658370 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5d2911-ded3-46c6-bf74-d999f40567d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:26.659177 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5d2911-ded3-46c6-bf74-d999f40567d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:26.661420 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5d2911-ded3-46c6-bf74-d999f40567d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:26.661956 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5d2911-ded3-46c6-bf74-d999f40567d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:26.857065 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-aa5d2911-ded3-46c6-bf74-d999f40567d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:26.864688 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-aa5d2911-ded3-46c6-bf74-d999f40567d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.222308 Jan 28 20:27:26.865253 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 117/238] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:26 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:27.279745 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-6340a8e5-a271-4962-8444-a7a881cd6ffb tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:27.280678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-6340a8e5-a271-4962-8444-a7a881cd6ffb tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:27.280976 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-76064e0f-3016-4e32-9398-c9d3bff767d9 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:27.281660 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-76064e0f-3016-4e32-9398-c9d3bff767d9 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:27.287289 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6340a8e5-a271-4962-8444-a7a881cd6ffb tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:27.287580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-76064e0f-3016-4e32-9398-c9d3bff767d9 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:27.287738 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6340a8e5-a271-4962-8444-a7a881cd6ffb tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:27.288187 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-76064e0f-3016-4e32-9398-c9d3bff767d9 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:27.288540 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6340a8e5-a271-4962-8444-a7a881cd6ffb tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:27.288964 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6340a8e5-a271-4962-8444-a7a881cd6ffb tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:27.289288 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-76064e0f-3016-4e32-9398-c9d3bff767d9 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:27.289775 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-76064e0f-3016-4e32-9398-c9d3bff767d9 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:27.438807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-6340a8e5-a271-4962-8444-a7a881cd6ffb tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:27.447932 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-6340a8e5-a271-4962-8444-a7a881cd6ffb tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.172405 Jan 28 20:27:27.448669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 122/239] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:27 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:27.566852 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-76064e0f-3016-4e32-9398-c9d3bff767d9 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:27.574431 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-76064e0f-3016-4e32-9398-c9d3bff767d9 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1554 microversion: 2.1 time: 0.297639 Jan 28 20:27:27.574992 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 118/240] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:27 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1554 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:27.882225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8f4fbbc5-5f0f-4f4a-9d78-63b07cdcfa00 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:27.882856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8f4fbbc5-5f0f-4f4a-9d78-63b07cdcfa00 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:27.891255 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8f4fbbc5-5f0f-4f4a-9d78-63b07cdcfa00 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:27.891696 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8f4fbbc5-5f0f-4f4a-9d78-63b07cdcfa00 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:27.892468 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8f4fbbc5-5f0f-4f4a-9d78-63b07cdcfa00 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:27.892893 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8f4fbbc5-5f0f-4f4a-9d78-63b07cdcfa00 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:28.040947 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8f4fbbc5-5f0f-4f4a-9d78-63b07cdcfa00 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:28.048123 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8f4fbbc5-5f0f-4f4a-9d78-63b07cdcfa00 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.170653 Jan 28 20:27:28.048686 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 123/241] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:27 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:28.466030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c4837b61-5c33-4efb-8ace-537828bac0c1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:28.466594 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c4837b61-5c33-4efb-8ace-537828bac0c1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:28.472383 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c4837b61-5c33-4efb-8ace-537828bac0c1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:28.472829 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c4837b61-5c33-4efb-8ace-537828bac0c1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:28.473599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c4837b61-5c33-4efb-8ace-537828bac0c1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:28.474079 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c4837b61-5c33-4efb-8ace-537828bac0c1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:28.591099 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-533d3ca5-c758-43a7-900e-3c18884ab7ff tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:28.591711 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-533d3ca5-c758-43a7-900e-3c18884ab7ff tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:28.597932 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-533d3ca5-c758-43a7-900e-3c18884ab7ff tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:28.598415 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-533d3ca5-c758-43a7-900e-3c18884ab7ff tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:28.599243 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-533d3ca5-c758-43a7-900e-3c18884ab7ff tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:28.599620 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-533d3ca5-c758-43a7-900e-3c18884ab7ff tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:28.601156 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c4837b61-5c33-4efb-8ace-537828bac0c1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:28.609669 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c4837b61-5c33-4efb-8ace-537828bac0c1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.147281 Jan 28 20:27:28.610659 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 119/242] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:28 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:28.735712 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-533d3ca5-c758-43a7-900e-3c18884ab7ff tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:28.743335 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-533d3ca5-c758-43a7-900e-3c18884ab7ff tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1554 microversion: 2.1 time: 0.155891 Jan 28 20:27:28.743899 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 124/243] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:28 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:29.064157 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9371cdb8-4fe5-4457-8cee-1a91bf68afd3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:29.064791 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9371cdb8-4fe5-4457-8cee-1a91bf68afd3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:29.070590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9371cdb8-4fe5-4457-8cee-1a91bf68afd3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:29.071034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9371cdb8-4fe5-4457-8cee-1a91bf68afd3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:29.071807 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9371cdb8-4fe5-4457-8cee-1a91bf68afd3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:29.072238 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9371cdb8-4fe5-4457-8cee-1a91bf68afd3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:29.207028 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9371cdb8-4fe5-4457-8cee-1a91bf68afd3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:29.215244 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9371cdb8-4fe5-4457-8cee-1a91bf68afd3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.153718 Jan 28 20:27:29.215817 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 120/244] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:29 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:29.626927 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a859422a-d3fe-42a5-8176-9ad9a84293f0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:29.627527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a859422a-d3fe-42a5-8176-9ad9a84293f0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:29.633727 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a859422a-d3fe-42a5-8176-9ad9a84293f0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:29.634204 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a859422a-d3fe-42a5-8176-9ad9a84293f0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:29.634966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a859422a-d3fe-42a5-8176-9ad9a84293f0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:29.635388 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a859422a-d3fe-42a5-8176-9ad9a84293f0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:29.760518 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e1b49812-e08d-453e-84e3-ed6fc14eeaad tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:29.761230 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e1b49812-e08d-453e-84e3-ed6fc14eeaad tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:29.766953 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e1b49812-e08d-453e-84e3-ed6fc14eeaad tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:29.767406 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e1b49812-e08d-453e-84e3-ed6fc14eeaad tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:29.767753 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a859422a-d3fe-42a5-8176-9ad9a84293f0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:29.768181 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e1b49812-e08d-453e-84e3-ed6fc14eeaad tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:29.768612 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e1b49812-e08d-453e-84e3-ed6fc14eeaad tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:29.775249 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a859422a-d3fe-42a5-8176-9ad9a84293f0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.151989 Jan 28 20:27:29.775835 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 125/245] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:29 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:29.897230 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e1b49812-e08d-453e-84e3-ed6fc14eeaad tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:29.905755 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e1b49812-e08d-453e-84e3-ed6fc14eeaad tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1554 microversion: 2.1 time: 0.148887 Jan 28 20:27:29.906348 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 121/246] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:29 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:30.233085 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-456501f7-8837-4125-856b-d2b20979d2f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:30.234527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-456501f7-8837-4125-856b-d2b20979d2f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:30.240743 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-456501f7-8837-4125-856b-d2b20979d2f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:30.241398 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-456501f7-8837-4125-856b-d2b20979d2f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:30.242351 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-456501f7-8837-4125-856b-d2b20979d2f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:30.242958 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-456501f7-8837-4125-856b-d2b20979d2f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:30.418222 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-456501f7-8837-4125-856b-d2b20979d2f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:30.427143 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-456501f7-8837-4125-856b-d2b20979d2f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.198611 Jan 28 20:27:30.427719 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 126/247] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:30 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:30.730004 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-c31cc55f-87fe-4986-87f7-6efba0f931cb req-f3f10033-94ba-4862-a45a-e67914e67400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b405f1-b1ca-40f2-b5e4-bcb87f2737e5", "name": "network-vif-deleted", "tag": "2ecf8276-1c36-4e6c-99da-0f2b8a872774"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:30.731620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:27:30.731620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:27:30.740198 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-c31cc55f-87fe-4986-87f7-6efba0f931cb req-f3f10033-94ba-4862-a45a-e67914e67400 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:30.740640 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-c31cc55f-87fe-4986-87f7-6efba0f931cb req-f3f10033-94ba-4862-a45a-e67914e67400 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:30.753571 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-c31cc55f-87fe-4986-87f7-6efba0f931cb req-f3f10033-94ba-4862-a45a-e67914e67400 service nova] Creating event network-vif-deleted:2ecf8276-1c36-4e6c-99da-0f2b8a872774 for instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 on hv-cinder-82635 Jan 28 20:27:30.760005 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-c31cc55f-87fe-4986-87f7-6efba0f931cb req-f3f10033-94ba-4862-a45a-e67914e67400 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033583 Jan 28 20:27:30.760613 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 122/248] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:27:30.793203 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-fdbe6edf-f969-4d08-a2ae-a688598082f4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:30.793812 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-fdbe6edf-f969-4d08-a2ae-a688598082f4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:30.800109 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fdbe6edf-f969-4d08-a2ae-a688598082f4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:30.800627 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fdbe6edf-f969-4d08-a2ae-a688598082f4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:30.801503 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fdbe6edf-f969-4d08-a2ae-a688598082f4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:30.801990 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fdbe6edf-f969-4d08-a2ae-a688598082f4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:30.924085 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e0907b7e-fc2f-4354-8920-58b777388e4d tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:30.924775 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e0907b7e-fc2f-4354-8920-58b777388e4d tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:30.930786 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e0907b7e-fc2f-4354-8920-58b777388e4d tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:30.931237 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e0907b7e-fc2f-4354-8920-58b777388e4d tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:30.932010 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e0907b7e-fc2f-4354-8920-58b777388e4d tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:30.932440 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e0907b7e-fc2f-4354-8920-58b777388e4d tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:30.936728 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-fdbe6edf-f969-4d08-a2ae-a688598082f4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:30.944009 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-fdbe6edf-f969-4d08-a2ae-a688598082f4 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.155173 Jan 28 20:27:30.944701 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 127/249] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:30 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:30.992016 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e0907b7e-fc2f-4354-8920-58b777388e4d tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:30.999220 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e0907b7e-fc2f-4354-8920-58b777388e4d tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1346 microversion: 2.1 time: 0.079175 Jan 28 20:27:30.999775 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 123/250] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:30 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:31.134435 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1151771723", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:31.184438 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] validate_networks() for None {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:27:31.270549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1489514358", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "networks": [{"uuid": "f7cd137c-ce2e-4c82-9033-a14c7af1ce8b"}]}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:31.320094 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] validate_networks() for [('f7cd137c-ce2e-4c82-9033-a14c7af1ce8b', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:27:31.713126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:27:31.713659 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:27:31.714169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:27:31.715250 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:27:31.715664 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:27:31.724933 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:31.725407 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:31.726232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:31.726655 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:31.742929 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Getting quotas for project 1a22c702c3fa4fcb93c739947f446def. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:27:31.746735 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Getting quotas for user a9677bb92c4049c79eb274649acbfccb and project 1a22c702c3fa4fcb93c739947f446def. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:27:31.757505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:27:31.759913 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:27:31.805679 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b6cf6212-f39b-4a8c-ad2b-d3b3161352c3 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674799 Jan 28 20:27:31.806386 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 128/251] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:27:31.810569 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-dc5aaf78-c5a0-4870-83d5-47a81421dfa9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:31.811347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-dc5aaf78-c5a0-4870-83d5-47a81421dfa9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:31.817289 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dc5aaf78-c5a0-4870-83d5-47a81421dfa9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:31.817739 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dc5aaf78-c5a0-4870-83d5-47a81421dfa9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:31.818550 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dc5aaf78-c5a0-4870-83d5-47a81421dfa9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:31.818977 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dc5aaf78-c5a0-4870-83d5-47a81421dfa9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:32.041856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-dc5aaf78-c5a0-4870-83d5-47a81421dfa9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:32.044537 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:27:32.045024 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:27:32.045505 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:27:32.045938 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:27:32.046348 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:27:32.051285 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-dc5aaf78-c5a0-4870-83d5-47a81421dfa9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.243841 Jan 28 20:27:32.052472 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 129/252] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:31 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:32.055675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:32.056120 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:32.056930 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:32.057362 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:32.057565 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f26d3036-6462-4b4f-9423-7de13633bf2a tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:32.058321 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f26d3036-6462-4b4f-9423-7de13633bf2a tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:32.076328 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Getting quotas for project d73cfa908e094fa0b8fbc1e550e29d20. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:27:32.080759 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Getting quotas for user 588b4e7353d2411ca853605fa586c8e8 and project d73cfa908e094fa0b8fbc1e550e29d20. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:27:32.093395 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:27:32.095828 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:27:32.114107 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f26d3036-6462-4b4f-9423-7de13633bf2a tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:32.121602 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f26d3036-6462-4b4f-9423-7de13633bf2a tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1215 microversion: 2.1 time: 0.068040 Jan 28 20:27:32.122537 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 130/253] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:32 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:32.126993 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-88903c68-d47e-4e9c-9cbe-e5b5146c62e1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:32.127929 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-88903c68-d47e-4e9c-9cbe-e5b5146c62e1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:32.134082 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88903c68-d47e-4e9c-9cbe-e5b5146c62e1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:32.134535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88903c68-d47e-4e9c-9cbe-e5b5146c62e1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:32.135322 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88903c68-d47e-4e9c-9cbe-e5b5146c62e1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:32.135754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88903c68-d47e-4e9c-9cbe-e5b5146c62e1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:32.146887 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ae0c1a7b-ab22-48e5-8432-5f3481a69cf1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879906 Jan 28 20:27:32.147936 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 124/254] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 20:27:32.153303 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0b30f944-3fa2-4429-bbd3-812d1695519c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:32.154103 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0b30f944-3fa2-4429-bbd3-812d1695519c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:32.161407 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0b30f944-3fa2-4429-bbd3-812d1695519c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:32.161963 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0b30f944-3fa2-4429-bbd3-812d1695519c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:32.162748 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0b30f944-3fa2-4429-bbd3-812d1695519c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:32.163170 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0b30f944-3fa2-4429-bbd3-812d1695519c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:32.245278 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-0b30f944-3fa2-4429-bbd3-812d1695519c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:32.253420 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0b30f944-3fa2-4429-bbd3-812d1695519c tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1346 microversion: 2.1 time: 0.104317 Jan 28 20:27:32.254512 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 125/255] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:32 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:32.268372 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-83079e8c-5f00-4cbf-8484-88764bd8c8ce tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:32.269160 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-83079e8c-5f00-4cbf-8484-88764bd8c8ce tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:32.338874 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-83079e8c-5f00-4cbf-8484-88764bd8c8ce tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:32.344891 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-88903c68-d47e-4e9c-9cbe-e5b5146c62e1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:32.346110 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-83079e8c-5f00-4cbf-8484-88764bd8c8ce tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1218 microversion: 2.1 time: 0.086821 Jan 28 20:27:32.346695 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 126/256] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:32 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:32.359281 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-88903c68-d47e-4e9c-9cbe-e5b5146c62e1 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.235529 Jan 28 20:27:32.360094 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 131/257] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:32 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:33.068044 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8ea88102-4fac-4e63-b8d0-e2f3911bd589 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:33.068575 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8ea88102-4fac-4e63-b8d0-e2f3911bd589 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:33.075006 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ea88102-4fac-4e63-b8d0-e2f3911bd589 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.075454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ea88102-4fac-4e63-b8d0-e2f3911bd589 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.076222 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ea88102-4fac-4e63-b8d0-e2f3911bd589 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.076655 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ea88102-4fac-4e63-b8d0-e2f3911bd589 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.138452 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-469e4a6d-32cf-4d5d-8dcf-b6e43cb51c68 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:33.139065 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-469e4a6d-32cf-4d5d-8dcf-b6e43cb51c68 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:33.145173 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-469e4a6d-32cf-4d5d-8dcf-b6e43cb51c68 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.145616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-469e4a6d-32cf-4d5d-8dcf-b6e43cb51c68 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.146415 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-469e4a6d-32cf-4d5d-8dcf-b6e43cb51c68 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.146846 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-469e4a6d-32cf-4d5d-8dcf-b6e43cb51c68 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.208115 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-469e4a6d-32cf-4d5d-8dcf-b6e43cb51c68 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:33.215262 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-469e4a6d-32cf-4d5d-8dcf-b6e43cb51c68 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1219 microversion: 2.1 time: 0.080422 Jan 28 20:27:33.215833 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 132/258] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:33 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:33.228857 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8ea88102-4fac-4e63-b8d0-e2f3911bd589 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:33.236818 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8ea88102-4fac-4e63-b8d0-e2f3911bd589 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.172503 Jan 28 20:27:33.237371 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 127/259] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:33 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:33.269952 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3a159868-9565-43d1-86d8-afa2185504b0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:33.270554 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3a159868-9565-43d1-86d8-afa2185504b0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:33.276442 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a159868-9565-43d1-86d8-afa2185504b0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.276922 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a159868-9565-43d1-86d8-afa2185504b0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.277789 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a159868-9565-43d1-86d8-afa2185504b0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.278309 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a159868-9565-43d1-86d8-afa2185504b0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.340193 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3a159868-9565-43d1-86d8-afa2185504b0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:33.347786 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3a159868-9565-43d1-86d8-afa2185504b0 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1346 microversion: 2.1 time: 0.081355 Jan 28 20:27:33.348351 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 133/260] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:33 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:33.362569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-aa18c7ee-afeb-4513-83fe-14bb4bc5ca48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:33.363172 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-aa18c7ee-afeb-4513-83fe-14bb4bc5ca48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:33.368896 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa18c7ee-afeb-4513-83fe-14bb4bc5ca48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.369332 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa18c7ee-afeb-4513-83fe-14bb4bc5ca48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.370122 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa18c7ee-afeb-4513-83fe-14bb4bc5ca48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.371243 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa18c7ee-afeb-4513-83fe-14bb4bc5ca48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.377551 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b1f89b4e-c3c0-4bcd-a9f4-c91058c6dab6 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:33.378175 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b1f89b4e-c3c0-4bcd-a9f4-c91058c6dab6 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:33.383821 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1f89b4e-c3c0-4bcd-a9f4-c91058c6dab6 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.384265 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1f89b4e-c3c0-4bcd-a9f4-c91058c6dab6 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.385037 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1f89b4e-c3c0-4bcd-a9f4-c91058c6dab6 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:33.385468 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1f89b4e-c3c0-4bcd-a9f4-c91058c6dab6 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:33.430689 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-aa18c7ee-afeb-4513-83fe-14bb4bc5ca48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:33.438766 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-aa18c7ee-afeb-4513-83fe-14bb4bc5ca48 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1222 microversion: 2.1 time: 0.079723 Jan 28 20:27:33.439331 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 128/261] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:33 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:33.527160 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b1f89b4e-c3c0-4bcd-a9f4-c91058c6dab6 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:33.534697 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b1f89b4e-c3c0-4bcd-a9f4-c91058c6dab6 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.160671 Jan 28 20:27:33.535261 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 134/262] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:33 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:34.232387 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5eedc412-782d-4d2b-87c3-490aae7e5859 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:34.233110 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5eedc412-782d-4d2b-87c3-490aae7e5859 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:34.239089 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5eedc412-782d-4d2b-87c3-490aae7e5859 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.239525 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5eedc412-782d-4d2b-87c3-490aae7e5859 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.240299 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5eedc412-782d-4d2b-87c3-490aae7e5859 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.240776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5eedc412-782d-4d2b-87c3-490aae7e5859 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.253772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e1f768c7-23bf-4403-838e-16ed95687eea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:34.254405 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e1f768c7-23bf-4403-838e-16ed95687eea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:34.260705 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1f768c7-23bf-4403-838e-16ed95687eea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.261223 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1f768c7-23bf-4403-838e-16ed95687eea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.262236 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1f768c7-23bf-4403-838e-16ed95687eea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.262668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1f768c7-23bf-4403-838e-16ed95687eea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.303440 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5eedc412-782d-4d2b-87c3-490aae7e5859 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:34.310774 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5eedc412-782d-4d2b-87c3-490aae7e5859 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1219 microversion: 2.1 time: 0.082611 Jan 28 20:27:34.311442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 129/263] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:34 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:34.364234 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c75399d9-9a62-4e06-bb2a-0810ef640a61 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:34.364964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c75399d9-9a62-4e06-bb2a-0810ef640a61 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:34.370986 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c75399d9-9a62-4e06-bb2a-0810ef640a61 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.371426 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c75399d9-9a62-4e06-bb2a-0810ef640a61 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.372196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c75399d9-9a62-4e06-bb2a-0810ef640a61 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.372621 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c75399d9-9a62-4e06-bb2a-0810ef640a61 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.405448 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e1f768c7-23bf-4403-838e-16ed95687eea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:34.412694 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e1f768c7-23bf-4403-838e-16ed95687eea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.162505 Jan 28 20:27:34.413266 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 135/264] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:34 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:34.432432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c75399d9-9a62-4e06-bb2a-0810ef640a61 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:34.440333 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c75399d9-9a62-4e06-bb2a-0810ef640a61 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1346 microversion: 2.1 time: 0.079754 Jan 28 20:27:34.440890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 130/265] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:34 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:34.454502 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c5aa9082-f44b-4ad5-a516-4810206ca637 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:34.455112 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c5aa9082-f44b-4ad5-a516-4810206ca637 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:34.460887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c5aa9082-f44b-4ad5-a516-4810206ca637 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.461329 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c5aa9082-f44b-4ad5-a516-4810206ca637 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.462152 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c5aa9082-f44b-4ad5-a516-4810206ca637 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.462581 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c5aa9082-f44b-4ad5-a516-4810206ca637 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.518909 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c5aa9082-f44b-4ad5-a516-4810206ca637 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:34.526004 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c5aa9082-f44b-4ad5-a516-4810206ca637 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1222 microversion: 2.1 time: 0.075067 Jan 28 20:27:34.527086 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 136/266] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:34 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:34.551990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f593eb41-c876-49ce-8d06-0efcfccb629c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:34.552583 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f593eb41-c876-49ce-8d06-0efcfccb629c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:34.558367 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f593eb41-c876-49ce-8d06-0efcfccb629c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.558808 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f593eb41-c876-49ce-8d06-0efcfccb629c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.559572 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f593eb41-c876-49ce-8d06-0efcfccb629c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:34.559996 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f593eb41-c876-49ce-8d06-0efcfccb629c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:34.692588 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f593eb41-c876-49ce-8d06-0efcfccb629c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:34.700282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f593eb41-c876-49ce-8d06-0efcfccb629c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.151791 Jan 28 20:27:34.700853 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 131/267] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:34 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:35.327210 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-98cd77ac-9c5a-4d99-b368-a6e7a4f0f8b1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:35.328414 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-98cd77ac-9c5a-4d99-b368-a6e7a4f0f8b1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:35.334677 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-98cd77ac-9c5a-4d99-b368-a6e7a4f0f8b1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.335058 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-98cd77ac-9c5a-4d99-b368-a6e7a4f0f8b1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.335821 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-98cd77ac-9c5a-4d99-b368-a6e7a4f0f8b1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.336244 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-98cd77ac-9c5a-4d99-b368-a6e7a4f0f8b1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.394669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-98cd77ac-9c5a-4d99-b368-a6e7a4f0f8b1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:35.401711 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-98cd77ac-9c5a-4d99-b368-a6e7a4f0f8b1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1267 microversion: 2.1 time: 0.078243 Jan 28 20:27:35.402302 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 137/268] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:35 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:35.429697 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-90d92ac2-892c-4f72-87be-795249fad9b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:35.430428 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-90d92ac2-892c-4f72-87be-795249fad9b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:35.437405 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90d92ac2-892c-4f72-87be-795249fad9b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.437954 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90d92ac2-892c-4f72-87be-795249fad9b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.438972 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90d92ac2-892c-4f72-87be-795249fad9b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.439605 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90d92ac2-892c-4f72-87be-795249fad9b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.456632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0c2e0cdd-4183-4053-8421-18414cc82389 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:35.457203 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0c2e0cdd-4183-4053-8421-18414cc82389 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:35.465146 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c2e0cdd-4183-4053-8421-18414cc82389 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.466279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c2e0cdd-4183-4053-8421-18414cc82389 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.467645 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c2e0cdd-4183-4053-8421-18414cc82389 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.468098 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c2e0cdd-4183-4053-8421-18414cc82389 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.564211 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0c2e0cdd-4183-4053-8421-18414cc82389 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:35.571949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0c2e0cdd-4183-4053-8421-18414cc82389 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1346 microversion: 2.1 time: 0.119337 Jan 28 20:27:35.581106 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 138/269] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:35 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:35.581106 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bced2ca1-1c00-4a80-baaa-e6a92ea54152 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:35.581106 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bced2ca1-1c00-4a80-baaa-e6a92ea54152 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:35.583820 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bced2ca1-1c00-4a80-baaa-e6a92ea54152 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.584267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bced2ca1-1c00-4a80-baaa-e6a92ea54152 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.585101 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bced2ca1-1c00-4a80-baaa-e6a92ea54152 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.585481 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bced2ca1-1c00-4a80-baaa-e6a92ea54152 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.656030 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bced2ca1-1c00-4a80-baaa-e6a92ea54152 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:35.663532 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bced2ca1-1c00-4a80-baaa-e6a92ea54152 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1270 microversion: 2.1 time: 0.089701 Jan 28 20:27:35.664118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 139/270] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:35 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:35.667093 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-90d92ac2-892c-4f72-87be-795249fad9b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:35.675820 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-90d92ac2-892c-4f72-87be-795249fad9b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.249723 Jan 28 20:27:35.677115 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 132/271] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:35 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:35.717780 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-366ba42e-e663-4d9d-a4f0-2cc02c3e1506 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:35.718476 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-366ba42e-e663-4d9d-a4f0-2cc02c3e1506 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:35.724484 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-366ba42e-e663-4d9d-a4f0-2cc02c3e1506 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.724980 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-366ba42e-e663-4d9d-a4f0-2cc02c3e1506 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.725979 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-366ba42e-e663-4d9d-a4f0-2cc02c3e1506 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:35.726454 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-366ba42e-e663-4d9d-a4f0-2cc02c3e1506 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:35.936856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-366ba42e-e663-4d9d-a4f0-2cc02c3e1506 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:35.945485 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-366ba42e-e663-4d9d-a4f0-2cc02c3e1506 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.232536 Jan 28 20:27:35.946287 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 140/272] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:35 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:36.419229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8cac05c8-4e72-4e40-b903-9c742a80befe tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:36.419880 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8cac05c8-4e72-4e40-b903-9c742a80befe tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:36.427036 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8cac05c8-4e72-4e40-b903-9c742a80befe tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.427997 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8cac05c8-4e72-4e40-b903-9c742a80befe tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.429157 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8cac05c8-4e72-4e40-b903-9c742a80befe tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.429790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8cac05c8-4e72-4e40-b903-9c742a80befe tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.524932 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8cac05c8-4e72-4e40-b903-9c742a80befe tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:36.536913 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8cac05c8-4e72-4e40-b903-9c742a80befe tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1273 microversion: 2.1 time: 0.121696 Jan 28 20:27:36.541279 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 133/273] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:36 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:36.589725 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:36.591660 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:36.600978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.601660 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.603251 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.604246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.655623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.656792 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.657488 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lazy-loading 'fault' on Instance uuid 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:27:36.683589 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e4906d7d-385a-4a73-a4db-3dc164a80c91 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:36.684394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e4906d7d-385a-4a73-a4db-3dc164a80c91 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:36.702130 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e4906d7d-385a-4a73-a4db-3dc164a80c91 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.702584 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e4906d7d-385a-4a73-a4db-3dc164a80c91 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.703420 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e4906d7d-385a-4a73-a4db-3dc164a80c91 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.703901 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e4906d7d-385a-4a73-a4db-3dc164a80c91 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.741297 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a5b794b20746febe0b56190b514595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c5f9b9efd145cca6f89a538c9f0cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:36.749552 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2aef558c-47d0-42ba-a359-583ba6fd0798 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 200 len: 1305 microversion: 2.1 time: 0.163713 Jan 28 20:27:36.750401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 141/274] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:36 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 1305 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:36.755916 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4e5640b3-470a-4460-aaa7-451435a2256c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:36.756694 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4e5640b3-470a-4460-aaa7-451435a2256c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:36.762908 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4e5640b3-470a-4460-aaa7-451435a2256c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.763436 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4e5640b3-470a-4460-aaa7-451435a2256c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.764396 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4e5640b3-470a-4460-aaa7-451435a2256c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.764894 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4e5640b3-470a-4460-aaa7-451435a2256c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.791862 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e4906d7d-385a-4a73-a4db-3dc164a80c91 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:36.802301 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e4906d7d-385a-4a73-a4db-3dc164a80c91 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1276 microversion: 2.1 time: 0.124896 Jan 28 20:27:36.803226 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 134/275] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:36 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:36.963279 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a529ee98-4113-4ab1-8376-52ea903b75d7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:36.963894 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a529ee98-4113-4ab1-8376-52ea903b75d7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:36.970164 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a529ee98-4113-4ab1-8376-52ea903b75d7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.970761 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a529ee98-4113-4ab1-8376-52ea903b75d7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:36.971749 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a529ee98-4113-4ab1-8376-52ea903b75d7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:36.972184 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a529ee98-4113-4ab1-8376-52ea903b75d7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:37.006678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4e5640b3-470a-4460-aaa7-451435a2256c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:37.016085 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4e5640b3-470a-4460-aaa7-451435a2256c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.264143 Jan 28 20:27:37.017023 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 142/276] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:36 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:37.163980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a529ee98-4113-4ab1-8376-52ea903b75d7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:37.174214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a529ee98-4113-4ab1-8376-52ea903b75d7 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.213722 Jan 28 20:27:37.181900 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 135/277] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:36 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:37.561397 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-84816dce-aa5f-41fe-82ad-4a30371d6547 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:37.562143 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-84816dce-aa5f-41fe-82ad-4a30371d6547 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:37.576133 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-84816dce-aa5f-41fe-82ad-4a30371d6547 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:37.577984 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-84816dce-aa5f-41fe-82ad-4a30371d6547 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:37.581300 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-84816dce-aa5f-41fe-82ad-4a30371d6547 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:37.581747 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-84816dce-aa5f-41fe-82ad-4a30371d6547 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:37.688028 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-84816dce-aa5f-41fe-82ad-4a30371d6547 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:37.696062 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-84816dce-aa5f-41fe-82ad-4a30371d6547 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1273 microversion: 2.1 time: 0.140252 Jan 28 20:27:37.696965 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 143/278] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:37 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:37.768268 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-03ee6097-73c9-4c5b-ba0a-df79eec51991 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:37.769094 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-03ee6097-73c9-4c5b-ba0a-df79eec51991 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:37.775725 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-03ee6097-73c9-4c5b-ba0a-df79eec51991 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:37.776176 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-03ee6097-73c9-4c5b-ba0a-df79eec51991 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:37.777685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-03ee6097-73c9-4c5b-ba0a-df79eec51991 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:37.778140 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-03ee6097-73c9-4c5b-ba0a-df79eec51991 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:37.793325 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-03ee6097-73c9-4c5b-ba0a-df79eec51991 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] HTTP exception thrown: Instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 could not be found. Jan 28 20:27:37.794010 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-03ee6097-73c9-4c5b-ba0a-df79eec51991 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Returning 404 to user: Instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:27:37.794848 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-03ee6097-73c9-4c5b-ba0a-df79eec51991 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 404 len: 111 microversion: 2.1 time: 0.030746 Jan 28 20:27:37.795457 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 136/279] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:37 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:27:37.820944 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c2c54368-9620-4677-a2a6-1bc3cc66d454 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:37.821800 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c2c54368-9620-4677-a2a6-1bc3cc66d454 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:37.830627 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c2c54368-9620-4677-a2a6-1bc3cc66d454 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:37.831342 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c2c54368-9620-4677-a2a6-1bc3cc66d454 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:37.833013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c2c54368-9620-4677-a2a6-1bc3cc66d454 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:37.833651 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c2c54368-9620-4677-a2a6-1bc3cc66d454 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:37.967113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b82c9908-e908-4972-b8e7-38f0d5a70e89 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:37.968324 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b82c9908-e908-4972-b8e7-38f0d5a70e89 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:37.980075 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b82c9908-e908-4972-b8e7-38f0d5a70e89 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:37.981337 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b82c9908-e908-4972-b8e7-38f0d5a70e89 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:37.982585 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b82c9908-e908-4972-b8e7-38f0d5a70e89 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:37.984125 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b82c9908-e908-4972-b8e7-38f0d5a70e89 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:38.008233 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-b82c9908-e908-4972-b8e7-38f0d5a70e89 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] HTTP exception thrown: Instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 could not be found. Jan 28 20:27:38.008895 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b82c9908-e908-4972-b8e7-38f0d5a70e89 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Returning 404 to user: Instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:27:38.009843 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b82c9908-e908-4972-b8e7-38f0d5a70e89 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046570 Jan 28 20:27:38.019237 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c2c54368-9620-4677-a2a6-1bc3cc66d454 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:38.023196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 137/280] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:27:37 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 20:27:38.030498 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c2c54368-9620-4677-a2a6-1bc3cc66d454 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.212711 Jan 28 20:27:38.038552 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-67d54ebe-8578-45d4-955e-32474370c355 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:38.039375 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-67d54ebe-8578-45d4-955e-32474370c355 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:38.041350 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 144/281] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:37 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:38.052574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-67d54ebe-8578-45d4-955e-32474370c355 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:38.055648 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-67d54ebe-8578-45d4-955e-32474370c355 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:38.056860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-67d54ebe-8578-45d4-955e-32474370c355 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:38.056860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-67d54ebe-8578-45d4-955e-32474370c355 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:38.194924 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e60ad588-d89c-4a93-9526-6fc3f24df0d8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:38.198121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e60ad588-d89c-4a93-9526-6fc3f24df0d8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:38.216228 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e60ad588-d89c-4a93-9526-6fc3f24df0d8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:38.220408 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e60ad588-d89c-4a93-9526-6fc3f24df0d8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:38.222431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e60ad588-d89c-4a93-9526-6fc3f24df0d8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:38.224440 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e60ad588-d89c-4a93-9526-6fc3f24df0d8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:38.335048 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-67d54ebe-8578-45d4-955e-32474370c355 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:38.343059 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-67d54ebe-8578-45d4-955e-32474370c355 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.311581 Jan 28 20:27:38.352975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 138/282] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:38 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:38.435517 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e60ad588-d89c-4a93-9526-6fc3f24df0d8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:38.442842 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e60ad588-d89c-4a93-9526-6fc3f24df0d8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.254656 Jan 28 20:27:38.443649 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 145/283] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:38 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:38.715217 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-90d7ef7a-03f1-47c0-8a53-838e6022f43f tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:38.716184 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-90d7ef7a-03f1-47c0-8a53-838e6022f43f tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:38.724264 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90d7ef7a-03f1-47c0-8a53-838e6022f43f tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:38.724924 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90d7ef7a-03f1-47c0-8a53-838e6022f43f tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:38.727102 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90d7ef7a-03f1-47c0-8a53-838e6022f43f tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:38.727702 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-90d7ef7a-03f1-47c0-8a53-838e6022f43f tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:38.956205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-0b8c8511-9f8a-43e6-ae8d-816eb93258e4 req-0b5a562b-863a-476a-be61-01861ca4fc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74ff9a8b-3bae-4ba8-b484-a534d77d5e43", "tag": "ce9c009d-bd33-472f-8bed-913b4a444447"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:38.959243 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:27:38.959243 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:27:38.960565 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-90d7ef7a-03f1-47c0-8a53-838e6022f43f tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:38.974602 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-90d7ef7a-03f1-47c0-8a53-838e6022f43f tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.263175 Jan 28 20:27:38.975873 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 139/284] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:38 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:38.984024 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-0b8c8511-9f8a-43e6-ae8d-816eb93258e4 req-0b5a562b-863a-476a-be61-01861ca4fc20 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:38.985719 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-0b8c8511-9f8a-43e6-ae8d-816eb93258e4 req-0b5a562b-863a-476a-be61-01861ca4fc20 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.017575 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-0b8c8511-9f8a-43e6-ae8d-816eb93258e4 req-0b5a562b-863a-476a-be61-01861ca4fc20 service nova] Creating event network-changed:ce9c009d-bd33-472f-8bed-913b4a444447 for instance 74ff9a8b-3bae-4ba8-b484-a534d77d5e43 on hv-cinder-82635 Jan 28 20:27:39.030411 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-0b8c8511-9f8a-43e6-ae8d-816eb93258e4 req-0b5a562b-863a-476a-be61-01861ca4fc20 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082296 Jan 28 20:27:39.031911 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 146/285] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:27:39.047282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-244fd047-16a7-4be7-a403-8d4358ff1705 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:39.047894 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-244fd047-16a7-4be7-a403-8d4358ff1705 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:39.054193 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-244fd047-16a7-4be7-a403-8d4358ff1705 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.054639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-244fd047-16a7-4be7-a403-8d4358ff1705 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.055583 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-244fd047-16a7-4be7-a403-8d4358ff1705 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.056200 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-244fd047-16a7-4be7-a403-8d4358ff1705 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.308694 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-244fd047-16a7-4be7-a403-8d4358ff1705 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:39.314238 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ecf604bd-7f7f-42bc-af86-860e80c6045e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:39.317057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ecf604bd-7f7f-42bc-af86-860e80c6045e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:39.324120 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-244fd047-16a7-4be7-a403-8d4358ff1705 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.280635 Jan 28 20:27:39.331514 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 140/286] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:39 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:39.347183 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecf604bd-7f7f-42bc-af86-860e80c6045e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.347632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecf604bd-7f7f-42bc-af86-860e80c6045e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.348433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecf604bd-7f7f-42bc-af86-860e80c6045e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.348865 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecf604bd-7f7f-42bc-af86-860e80c6045e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.360455 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3baf248f-9012-4cac-8df0-a5c973c49572 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:39.360666 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3baf248f-9012-4cac-8df0-a5c973c49572 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:39.373748 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-ecf604bd-7f7f-42bc-af86-860e80c6045e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] HTTP exception thrown: Instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 could not be found. Jan 28 20:27:39.374732 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ecf604bd-7f7f-42bc-af86-860e80c6045e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Returning 404 to user: Instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:27:39.375564 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ecf604bd-7f7f-42bc-af86-860e80c6045e tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "DELETE /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 404 len: 111 microversion: 2.1 time: 0.065464 Jan 28 20:27:39.378990 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 147/287] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:27:39 2022] DELETE /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:27:39.383731 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3baf248f-9012-4cac-8df0-a5c973c49572 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.384987 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3baf248f-9012-4cac-8df0-a5c973c49572 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.386697 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3baf248f-9012-4cac-8df0-a5c973c49572 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.387141 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3baf248f-9012-4cac-8df0-a5c973c49572 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.396956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a72ba5b9-5fc6-4fdb-8476-07eecb1c3c78 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:39.396956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a72ba5b9-5fc6-4fdb-8476-07eecb1c3c78 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] [instance: 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:39.422013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a72ba5b9-5fc6-4fdb-8476-07eecb1c3c78 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.423613 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a72ba5b9-5fc6-4fdb-8476-07eecb1c3c78 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.424665 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a72ba5b9-5fc6-4fdb-8476-07eecb1c3c78 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.425267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a72ba5b9-5fc6-4fdb-8476-07eecb1c3c78 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.469815 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-a72ba5b9-5fc6-4fdb-8476-07eecb1c3c78 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] HTTP exception thrown: Instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 could not be found. Jan 28 20:27:39.475803 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a72ba5b9-5fc6-4fdb-8476-07eecb1c3c78 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] Returning 404 to user: Instance 45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:27:39.476893 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a72ba5b9-5fc6-4fdb-8476-07eecb1c3c78 tempest-DeleteServersTestJSON-263683965 tempest-DeleteServersTestJSON-263683965-project] 10.222.0.59 "GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5" status: 404 len: 111 microversion: 2.1 time: 0.093258 Jan 28 20:27:39.480395 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 148/288] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:39 2022] GET /compute/v2.1/servers/45b405f1-b1ca-40f2-b5e4-bcb87f2737e5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:27:39.499857 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-efbeb00b-07fc-4450-bda4-3fe62ee9565d req-999caf1d-612e-4e0f-aa09-d82a475ce568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dd8af5-ad5a-461a-b185-54130ae59903", "name": "network-vif-plugged", "status": "completed", "tag": "68ef1535-e8b0-430f-a7e8-8b7631bf4fcc"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:39.501663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:27:39.501663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:27:39.521577 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-efbeb00b-07fc-4450-bda4-3fe62ee9565d req-999caf1d-612e-4e0f-aa09-d82a475ce568 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.522046 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-efbeb00b-07fc-4450-bda4-3fe62ee9565d req-999caf1d-612e-4e0f-aa09-d82a475ce568 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.539784 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-efbeb00b-07fc-4450-bda4-3fe62ee9565d req-999caf1d-612e-4e0f-aa09-d82a475ce568 service nova] Creating event network-vif-plugged:68ef1535-e8b0-430f-a7e8-8b7631bf4fcc for instance 08dd8af5-ad5a-461a-b185-54130ae59903 on hv-cinder-82635 Jan 28 20:27:39.555312 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-efbeb00b-07fc-4450-bda4-3fe62ee9565d req-999caf1d-612e-4e0f-aa09-d82a475ce568 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073401 Jan 28 20:27:39.557436 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 149/289] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:27:39.565022 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1b7a5995-d080-4079-a902-84b5b610038b tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:39.574469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1b7a5995-d080-4079-a902-84b5b610038b tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:39.589510 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b7a5995-d080-4079-a902-84b5b610038b tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.589760 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b7a5995-d080-4079-a902-84b5b610038b tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.595947 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b7a5995-d080-4079-a902-84b5b610038b tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:39.597323 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b7a5995-d080-4079-a902-84b5b610038b tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:39.762367 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3baf248f-9012-4cac-8df0-a5c973c49572 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:39.779276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3baf248f-9012-4cac-8df0-a5c973c49572 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.421796 Jan 28 20:27:39.780716 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 141/290] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:39 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:39.953043 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1b7a5995-d080-4079-a902-84b5b610038b tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:39.962340 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1b7a5995-d080-4079-a902-84b5b610038b tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.402599 Jan 28 20:27:39.964425 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 150/291] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:39 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:39.997038 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5dfa2457-bc7e-4b08-aa1b-6da49474eab0 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:39.998273 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5dfa2457-bc7e-4b08-aa1b-6da49474eab0 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:40.005321 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5dfa2457-bc7e-4b08-aa1b-6da49474eab0 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:40.006365 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5dfa2457-bc7e-4b08-aa1b-6da49474eab0 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:40.007359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5dfa2457-bc7e-4b08-aa1b-6da49474eab0 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:40.021156 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5dfa2457-bc7e-4b08-aa1b-6da49474eab0 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:40.191415 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5dfa2457-bc7e-4b08-aa1b-6da49474eab0 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:40.199752 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5dfa2457-bc7e-4b08-aa1b-6da49474eab0 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.208441 Jan 28 20:27:40.200334 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 142/292] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:39 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:40.348891 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0fd71585-4acd-49ec-a621-6d40f15ee481 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:40.349644 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0fd71585-4acd-49ec-a621-6d40f15ee481 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:40.355952 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0fd71585-4acd-49ec-a621-6d40f15ee481 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:40.356744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0fd71585-4acd-49ec-a621-6d40f15ee481 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:40.358238 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0fd71585-4acd-49ec-a621-6d40f15ee481 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:40.358811 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0fd71585-4acd-49ec-a621-6d40f15ee481 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:40.535293 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0fd71585-4acd-49ec-a621-6d40f15ee481 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:40.546778 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0fd71585-4acd-49ec-a621-6d40f15ee481 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.201415 Jan 28 20:27:40.547607 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 151/293] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:40 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:40.801107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d5c694e8-eafd-4b76-9578-81f1aabf34ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:40.809826 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d5c694e8-eafd-4b76-9578-81f1aabf34ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:40.824659 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d5c694e8-eafd-4b76-9578-81f1aabf34ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:40.825128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d5c694e8-eafd-4b76-9578-81f1aabf34ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:40.825976 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d5c694e8-eafd-4b76-9578-81f1aabf34ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:40.826425 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d5c694e8-eafd-4b76-9578-81f1aabf34ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:40.982131 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8ba5de38-61de-435a-9ed2-4d5ed566d131 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:40.983536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8ba5de38-61de-435a-9ed2-4d5ed566d131 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:40.999893 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ba5de38-61de-435a-9ed2-4d5ed566d131 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:41.000578 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ba5de38-61de-435a-9ed2-4d5ed566d131 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:41.000912 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d5c694e8-eafd-4b76-9578-81f1aabf34ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:41.002359 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ba5de38-61de-435a-9ed2-4d5ed566d131 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:41.002996 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ba5de38-61de-435a-9ed2-4d5ed566d131 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:41.009249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d5c694e8-eafd-4b76-9578-81f1aabf34ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.216006 Jan 28 20:27:41.010740 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 143/294] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:40 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:41.100814 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-a5aab836-4736-4339-ad1b-50ad778a56db req-7bbd817b-f3ad-459e-a4e3-177d33ce5efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fe010b-84f6-4fd1-9b37-5a169df50bdd", "tag": "1a57cf51-27e2-4d5d-b600-5a463219e79e"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:41.102549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:27:41.102549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:27:41.113288 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-a5aab836-4736-4339-ad1b-50ad778a56db req-7bbd817b-f3ad-459e-a4e3-177d33ce5efa service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:41.113740 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-a5aab836-4736-4339-ad1b-50ad778a56db req-7bbd817b-f3ad-459e-a4e3-177d33ce5efa service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:41.132887 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-a5aab836-4736-4339-ad1b-50ad778a56db req-7bbd817b-f3ad-459e-a4e3-177d33ce5efa service nova] Creating event network-changed:1a57cf51-27e2-4d5d-b600-5a463219e79e for instance e7fe010b-84f6-4fd1-9b37-5a169df50bdd on hv-cinder-82635 Jan 28 20:27:41.149978 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-a5aab836-4736-4339-ad1b-50ad778a56db req-7bbd817b-f3ad-459e-a4e3-177d33ce5efa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052718 Jan 28 20:27:41.156388 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 144/295] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:27:41.177483 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8ba5de38-61de-435a-9ed2-4d5ed566d131 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:41.192294 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8ba5de38-61de-435a-9ed2-4d5ed566d131 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.215607 Jan 28 20:27:41.193752 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 152/296] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:40 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:41.218835 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c5fc01ed-cf8e-424f-affd-635501823a47 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:41.219643 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c5fc01ed-cf8e-424f-affd-635501823a47 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:41.225921 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5fc01ed-cf8e-424f-affd-635501823a47 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:41.226566 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5fc01ed-cf8e-424f-affd-635501823a47 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:41.227561 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5fc01ed-cf8e-424f-affd-635501823a47 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:41.228282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5fc01ed-cf8e-424f-affd-635501823a47 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:41.462578 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c5fc01ed-cf8e-424f-affd-635501823a47 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:41.472041 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c5fc01ed-cf8e-424f-affd-635501823a47 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.258865 Jan 28 20:27:41.482139 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 145/297] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:41 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:41.565299 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7b2ebdfa-b71f-47b4-be1b-31b64ee37be7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:41.565900 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7b2ebdfa-b71f-47b4-be1b-31b64ee37be7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:41.571733 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7b2ebdfa-b71f-47b4-be1b-31b64ee37be7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:41.572378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7b2ebdfa-b71f-47b4-be1b-31b64ee37be7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:41.573356 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7b2ebdfa-b71f-47b4-be1b-31b64ee37be7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:41.574121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7b2ebdfa-b71f-47b4-be1b-31b64ee37be7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:41.778933 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7b2ebdfa-b71f-47b4-be1b-31b64ee37be7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:41.789017 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7b2ebdfa-b71f-47b4-be1b-31b64ee37be7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.228040 Jan 28 20:27:41.799920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 153/298] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:41 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:42.024648 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-93e10039-ad15-4a9f-ae87-8ccad6161771 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:42.025386 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-93e10039-ad15-4a9f-ae87-8ccad6161771 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:42.038872 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-93e10039-ad15-4a9f-ae87-8ccad6161771 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:42.039324 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-93e10039-ad15-4a9f-ae87-8ccad6161771 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:42.040303 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-93e10039-ad15-4a9f-ae87-8ccad6161771 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:42.040890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-93e10039-ad15-4a9f-ae87-8ccad6161771 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:42.184394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-93e10039-ad15-4a9f-ae87-8ccad6161771 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:42.192712 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-93e10039-ad15-4a9f-ae87-8ccad6161771 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.171871 Jan 28 20:27:42.193417 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 146/299] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:42 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:42.210306 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b8aa3144-dc2a-4beb-bcf5-c73d486c2e21 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:42.210927 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b8aa3144-dc2a-4beb-bcf5-c73d486c2e21 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:42.217916 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b8aa3144-dc2a-4beb-bcf5-c73d486c2e21 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:42.218510 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b8aa3144-dc2a-4beb-bcf5-c73d486c2e21 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:42.219295 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b8aa3144-dc2a-4beb-bcf5-c73d486c2e21 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:42.219720 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b8aa3144-dc2a-4beb-bcf5-c73d486c2e21 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:42.360991 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b8aa3144-dc2a-4beb-bcf5-c73d486c2e21 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:42.368276 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b8aa3144-dc2a-4beb-bcf5-c73d486c2e21 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1317 microversion: 2.1 time: 0.161670 Jan 28 20:27:42.368841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 154/300] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:42 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:42.489484 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8067d6cc-501f-421c-a6d6-8c188dc8a5bc tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:42.490120 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8067d6cc-501f-421c-a6d6-8c188dc8a5bc tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:42.497669 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8067d6cc-501f-421c-a6d6-8c188dc8a5bc tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:42.498276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8067d6cc-501f-421c-a6d6-8c188dc8a5bc tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:42.499217 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8067d6cc-501f-421c-a6d6-8c188dc8a5bc tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:42.499845 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8067d6cc-501f-421c-a6d6-8c188dc8a5bc tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:42.644779 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8067d6cc-501f-421c-a6d6-8c188dc8a5bc tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:42.653145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8067d6cc-501f-421c-a6d6-8c188dc8a5bc tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.167275 Jan 28 20:27:42.653717 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 147/301] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:42 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:42.809768 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ed3f296b-668d-4b0c-a9e6-5520bc915200 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:42.810336 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ed3f296b-668d-4b0c-a9e6-5520bc915200 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:42.818518 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed3f296b-668d-4b0c-a9e6-5520bc915200 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:42.818974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed3f296b-668d-4b0c-a9e6-5520bc915200 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:42.819828 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed3f296b-668d-4b0c-a9e6-5520bc915200 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:42.820269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed3f296b-668d-4b0c-a9e6-5520bc915200 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:42.996975 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ed3f296b-668d-4b0c-a9e6-5520bc915200 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:43.005963 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ed3f296b-668d-4b0c-a9e6-5520bc915200 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.202731 Jan 28 20:27:43.006734 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 155/302] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:42 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:43.209428 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7a73b0e6-c053-4354-b1e3-8b0848abeab2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:43.210146 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7a73b0e6-c053-4354-b1e3-8b0848abeab2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:43.217381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7a73b0e6-c053-4354-b1e3-8b0848abeab2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:43.217826 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7a73b0e6-c053-4354-b1e3-8b0848abeab2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:43.218633 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7a73b0e6-c053-4354-b1e3-8b0848abeab2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:43.219064 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7a73b0e6-c053-4354-b1e3-8b0848abeab2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:43.382675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7a73b0e6-c053-4354-b1e3-8b0848abeab2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:43.386831 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-da6386d4-a1a3-454d-8d2c-46c8e0f6745c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:43.388657 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-da6386d4-a1a3-454d-8d2c-46c8e0f6745c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:43.391525 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7a73b0e6-c053-4354-b1e3-8b0848abeab2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.185869 Jan 28 20:27:43.392709 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 148/303] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:43 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:43.395458 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-da6386d4-a1a3-454d-8d2c-46c8e0f6745c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:43.396081 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-da6386d4-a1a3-454d-8d2c-46c8e0f6745c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:43.396880 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-da6386d4-a1a3-454d-8d2c-46c8e0f6745c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:43.397293 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-da6386d4-a1a3-454d-8d2c-46c8e0f6745c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:43.555754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-da6386d4-a1a3-454d-8d2c-46c8e0f6745c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:43.564269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-da6386d4-a1a3-454d-8d2c-46c8e0f6745c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1506 microversion: 2.1 time: 0.182603 Jan 28 20:27:43.565233 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 156/304] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:43 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:43.671039 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dd462094-b46e-43dc-bc9a-1581ad029ff4 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:43.671754 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dd462094-b46e-43dc-bc9a-1581ad029ff4 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:43.678834 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dd462094-b46e-43dc-bc9a-1581ad029ff4 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:43.679502 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dd462094-b46e-43dc-bc9a-1581ad029ff4 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:43.680508 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dd462094-b46e-43dc-bc9a-1581ad029ff4 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:43.681301 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dd462094-b46e-43dc-bc9a-1581ad029ff4 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:43.900047 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dd462094-b46e-43dc-bc9a-1581ad029ff4 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:43.908588 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dd462094-b46e-43dc-bc9a-1581ad029ff4 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.242173 Jan 28 20:27:43.909862 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 149/305] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:43 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:44.023162 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8ea88f8d-96a1-4636-8845-aaaf86185463 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:44.023773 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8ea88f8d-96a1-4636-8845-aaaf86185463 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:44.038602 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ea88f8d-96a1-4636-8845-aaaf86185463 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:44.039306 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ea88f8d-96a1-4636-8845-aaaf86185463 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:44.040278 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ea88f8d-96a1-4636-8845-aaaf86185463 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:44.041068 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ea88f8d-96a1-4636-8845-aaaf86185463 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:44.236040 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8ea88f8d-96a1-4636-8845-aaaf86185463 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:44.244166 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8ea88f8d-96a1-4636-8845-aaaf86185463 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.224988 Jan 28 20:27:44.245693 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 157/306] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:44 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:44.408425 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8e5ce896-2c4f-4a0a-9eea-80694c35ba19 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:44.412382 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8e5ce896-2c4f-4a0a-9eea-80694c35ba19 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:44.423634 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8e5ce896-2c4f-4a0a-9eea-80694c35ba19 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:44.424171 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8e5ce896-2c4f-4a0a-9eea-80694c35ba19 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:44.424964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8e5ce896-2c4f-4a0a-9eea-80694c35ba19 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:44.425402 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8e5ce896-2c4f-4a0a-9eea-80694c35ba19 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:44.641111 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8e5ce896-2c4f-4a0a-9eea-80694c35ba19 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:44.650475 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8e5ce896-2c4f-4a0a-9eea-80694c35ba19 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.245843 Jan 28 20:27:44.651045 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 150/307] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:44 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:44.930089 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ad5249e6-f898-45c9-a843-08c1c02d0337 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:44.930089 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ad5249e6-f898-45c9-a843-08c1c02d0337 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:44.936244 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ad5249e6-f898-45c9-a843-08c1c02d0337 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:44.936693 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ad5249e6-f898-45c9-a843-08c1c02d0337 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:44.937616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ad5249e6-f898-45c9-a843-08c1c02d0337 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:44.938084 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ad5249e6-f898-45c9-a843-08c1c02d0337 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:45.122752 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ad5249e6-f898-45c9-a843-08c1c02d0337 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:45.131083 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ad5249e6-f898-45c9-a843-08c1c02d0337 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.206990 Jan 28 20:27:45.141128 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 158/308] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:44 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:45.261991 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-15db2598-d36e-4986-885b-3d06d9a70678 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:45.262785 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-15db2598-d36e-4986-885b-3d06d9a70678 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:45.270865 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-15db2598-d36e-4986-885b-3d06d9a70678 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:45.271680 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-15db2598-d36e-4986-885b-3d06d9a70678 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:45.272760 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-15db2598-d36e-4986-885b-3d06d9a70678 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:45.273432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-15db2598-d36e-4986-885b-3d06d9a70678 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:45.494748 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-15db2598-d36e-4986-885b-3d06d9a70678 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:45.503162 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-15db2598-d36e-4986-885b-3d06d9a70678 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.245239 Jan 28 20:27:45.503776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 151/309] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:45 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:45.668177 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8d5c1dee-108a-40e3-a637-2fb01076ff86 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:45.668918 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8d5c1dee-108a-40e3-a637-2fb01076ff86 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:45.681411 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8d5c1dee-108a-40e3-a637-2fb01076ff86 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:45.682052 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8d5c1dee-108a-40e3-a637-2fb01076ff86 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:45.683388 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8d5c1dee-108a-40e3-a637-2fb01076ff86 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:45.684008 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8d5c1dee-108a-40e3-a637-2fb01076ff86 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:45.827331 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8d5c1dee-108a-40e3-a637-2fb01076ff86 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:45.835138 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8d5c1dee-108a-40e3-a637-2fb01076ff86 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.171289 Jan 28 20:27:45.835739 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 159/310] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:45 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:46.147088 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0950cd3c-9053-4bfc-8c51-a9386dbd3782 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:46.148041 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0950cd3c-9053-4bfc-8c51-a9386dbd3782 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:46.154891 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0950cd3c-9053-4bfc-8c51-a9386dbd3782 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:46.155335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0950cd3c-9053-4bfc-8c51-a9386dbd3782 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:46.156116 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0950cd3c-9053-4bfc-8c51-a9386dbd3782 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:46.158341 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0950cd3c-9053-4bfc-8c51-a9386dbd3782 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:46.392157 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-0950cd3c-9053-4bfc-8c51-a9386dbd3782 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:46.400794 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0950cd3c-9053-4bfc-8c51-a9386dbd3782 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.257205 Jan 28 20:27:46.402132 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 152/311] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:46 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:46.520150 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-90cca3f2-23c5-4808-b9a2-5da7f35572eb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:46.520987 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-90cca3f2-23c5-4808-b9a2-5da7f35572eb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:46.532233 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-90cca3f2-23c5-4808-b9a2-5da7f35572eb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:46.533021 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-90cca3f2-23c5-4808-b9a2-5da7f35572eb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:46.533807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-90cca3f2-23c5-4808-b9a2-5da7f35572eb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:46.534372 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-90cca3f2-23c5-4808-b9a2-5da7f35572eb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:46.699928 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-90cca3f2-23c5-4808-b9a2-5da7f35572eb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:46.708039 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-90cca3f2-23c5-4808-b9a2-5da7f35572eb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.191363 Jan 28 20:27:46.708614 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 160/312] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:46 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:46.851786 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ed47ade6-8691-4ed7-b01c-a702f653adf7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:46.852922 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ed47ade6-8691-4ed7-b01c-a702f653adf7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:46.859778 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ed47ade6-8691-4ed7-b01c-a702f653adf7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:46.860229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ed47ade6-8691-4ed7-b01c-a702f653adf7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:46.861023 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ed47ade6-8691-4ed7-b01c-a702f653adf7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:46.861628 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ed47ade6-8691-4ed7-b01c-a702f653adf7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:47.011888 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ed47ade6-8691-4ed7-b01c-a702f653adf7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:47.019476 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ed47ade6-8691-4ed7-b01c-a702f653adf7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.171521 Jan 28 20:27:47.020214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 153/313] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:46 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:47.421196 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cf80cb8f-d2ff-4fb5-88da-ebd2ec97c0f8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:47.421794 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-cf80cb8f-d2ff-4fb5-88da-ebd2ec97c0f8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:47.427708 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cf80cb8f-d2ff-4fb5-88da-ebd2ec97c0f8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:47.428232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cf80cb8f-d2ff-4fb5-88da-ebd2ec97c0f8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:47.429006 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cf80cb8f-d2ff-4fb5-88da-ebd2ec97c0f8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:47.429431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cf80cb8f-d2ff-4fb5-88da-ebd2ec97c0f8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:47.571216 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cf80cb8f-d2ff-4fb5-88da-ebd2ec97c0f8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:47.581275 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-cf80cb8f-d2ff-4fb5-88da-ebd2ec97c0f8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.164094 Jan 28 20:27:47.581862 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 161/314] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:47 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:47.725470 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-966fdb70-93cc-4051-9881-f78c34aef8ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:47.726189 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-966fdb70-93cc-4051-9881-f78c34aef8ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:47.733347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-966fdb70-93cc-4051-9881-f78c34aef8ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:47.733886 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-966fdb70-93cc-4051-9881-f78c34aef8ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:47.734756 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-966fdb70-93cc-4051-9881-f78c34aef8ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:47.735262 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-966fdb70-93cc-4051-9881-f78c34aef8ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:47.877147 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-966fdb70-93cc-4051-9881-f78c34aef8ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:47.884360 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-966fdb70-93cc-4051-9881-f78c34aef8ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.162815 Jan 28 20:27:47.884929 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 154/315] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:47 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:48.036524 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4c44277d-5c5c-42f9-8844-af048a0004ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:48.037328 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4c44277d-5c5c-42f9-8844-af048a0004ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:48.043289 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4c44277d-5c5c-42f9-8844-af048a0004ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:48.043830 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4c44277d-5c5c-42f9-8844-af048a0004ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:48.044678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4c44277d-5c5c-42f9-8844-af048a0004ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:48.045159 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4c44277d-5c5c-42f9-8844-af048a0004ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:48.235282 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4c44277d-5c5c-42f9-8844-af048a0004ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:48.244531 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4c44277d-5c5c-42f9-8844-af048a0004ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1520 microversion: 2.1 time: 0.211804 Jan 28 20:27:48.245587 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 162/316] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:48 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:48.597210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a35fbca4-1fb0-4a33-86ca-ee024fbf4883 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:48.598201 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a35fbca4-1fb0-4a33-86ca-ee024fbf4883 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:48.604223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a35fbca4-1fb0-4a33-86ca-ee024fbf4883 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:48.605279 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a35fbca4-1fb0-4a33-86ca-ee024fbf4883 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:48.606278 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a35fbca4-1fb0-4a33-86ca-ee024fbf4883 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:48.606865 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a35fbca4-1fb0-4a33-86ca-ee024fbf4883 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:48.745423 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a35fbca4-1fb0-4a33-86ca-ee024fbf4883 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:48.753036 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a35fbca4-1fb0-4a33-86ca-ee024fbf4883 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.159451 Jan 28 20:27:48.753682 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 155/317] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:48 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:48.901976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c11a85ac-ead2-4541-bd8e-9cf9e31bf485 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:48.902669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c11a85ac-ead2-4541-bd8e-9cf9e31bf485 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:48.909353 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c11a85ac-ead2-4541-bd8e-9cf9e31bf485 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:48.909865 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c11a85ac-ead2-4541-bd8e-9cf9e31bf485 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:48.910760 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c11a85ac-ead2-4541-bd8e-9cf9e31bf485 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:48.911256 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c11a85ac-ead2-4541-bd8e-9cf9e31bf485 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:49.055674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c11a85ac-ead2-4541-bd8e-9cf9e31bf485 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:49.062857 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c11a85ac-ead2-4541-bd8e-9cf9e31bf485 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.165163 Jan 28 20:27:49.063507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 163/318] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:48 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:49.262921 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-50975699-a89f-4720-a167-1e7eda14299e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:49.264097 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-50975699-a89f-4720-a167-1e7eda14299e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:49.271013 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50975699-a89f-4720-a167-1e7eda14299e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:49.271832 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50975699-a89f-4720-a167-1e7eda14299e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:49.273104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50975699-a89f-4720-a167-1e7eda14299e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:49.273769 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50975699-a89f-4720-a167-1e7eda14299e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:49.328356 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-e44b54f4-37a1-40d0-8011-58281a95767b req-2766f1a3-a863-4eed-a795-446f49a5a12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ff9a8b-3bae-4ba8-b484-a534d77d5e43", "name": "network-vif-plugged", "status": "completed", "tag": "ce9c009d-bd33-472f-8bed-913b4a444447"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:49.330021 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:27:49.330021 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:27:49.347919 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-e44b54f4-37a1-40d0-8011-58281a95767b req-2766f1a3-a863-4eed-a795-446f49a5a12a service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:49.349098 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-e44b54f4-37a1-40d0-8011-58281a95767b req-2766f1a3-a863-4eed-a795-446f49a5a12a service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:49.363412 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-e44b54f4-37a1-40d0-8011-58281a95767b req-2766f1a3-a863-4eed-a795-446f49a5a12a service nova] Creating event network-vif-plugged:ce9c009d-bd33-472f-8bed-913b4a444447 for instance 74ff9a8b-3bae-4ba8-b484-a534d77d5e43 on hv-cinder-82635 Jan 28 20:27:49.369402 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-e44b54f4-37a1-40d0-8011-58281a95767b req-2766f1a3-a863-4eed-a795-446f49a5a12a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044658 Jan 28 20:27:49.371350 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 164/319] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:27:49.460937 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-50975699-a89f-4720-a167-1e7eda14299e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:49.469562 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-50975699-a89f-4720-a167-1e7eda14299e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1500 microversion: 2.1 time: 0.211287 Jan 28 20:27:49.470335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 156/320] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:49 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1500 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:49.486777 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f84d7b08-06ac-4261-9d16-3fe1bdbd7b01 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:49.488046 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f84d7b08-06ac-4261-9d16-3fe1bdbd7b01 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:49.498446 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f84d7b08-06ac-4261-9d16-3fe1bdbd7b01 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:49.498974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f84d7b08-06ac-4261-9d16-3fe1bdbd7b01 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:49.501103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f84d7b08-06ac-4261-9d16-3fe1bdbd7b01 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:49.501687 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f84d7b08-06ac-4261-9d16-3fe1bdbd7b01 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:49.655836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f84d7b08-06ac-4261-9d16-3fe1bdbd7b01 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:49.664124 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f84d7b08-06ac-4261-9d16-3fe1bdbd7b01 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1514 microversion: 2.1 time: 0.181900 Jan 28 20:27:49.664848 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 165/321] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:49 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:49.770586 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b618dbdc-2948-42a0-8b92-6e8f43f37e4b tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:49.771201 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b618dbdc-2948-42a0-8b92-6e8f43f37e4b tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:49.777287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b618dbdc-2948-42a0-8b92-6e8f43f37e4b tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:49.777744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b618dbdc-2948-42a0-8b92-6e8f43f37e4b tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:49.778579 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b618dbdc-2948-42a0-8b92-6e8f43f37e4b tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:49.779013 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b618dbdc-2948-42a0-8b92-6e8f43f37e4b tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:49.924791 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b618dbdc-2948-42a0-8b92-6e8f43f37e4b tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:49.934436 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b618dbdc-2948-42a0-8b92-6e8f43f37e4b tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.167335 Jan 28 20:27:49.934991 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 157/322] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:49 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:50.079414 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0c52c6e6-3636-4eff-a027-09e15156907a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:50.080076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0c52c6e6-3636-4eff-a027-09e15156907a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:50.086332 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c52c6e6-3636-4eff-a027-09e15156907a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:50.086776 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c52c6e6-3636-4eff-a027-09e15156907a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:50.087552 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c52c6e6-3636-4eff-a027-09e15156907a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:50.087982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c52c6e6-3636-4eff-a027-09e15156907a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:50.417956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0c52c6e6-3636-4eff-a027-09e15156907a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:50.425227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0c52c6e6-3636-4eff-a027-09e15156907a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1318 microversion: 2.1 time: 0.349402 Jan 28 20:27:50.426022 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 166/323] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:50 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:50.951592 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-fc764c1f-fa3d-418a-92ee-8009333d4081 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:50.952192 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-fc764c1f-fa3d-418a-92ee-8009333d4081 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:50.958063 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fc764c1f-fa3d-418a-92ee-8009333d4081 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:50.958486 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fc764c1f-fa3d-418a-92ee-8009333d4081 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:50.959254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fc764c1f-fa3d-418a-92ee-8009333d4081 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:50.959687 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fc764c1f-fa3d-418a-92ee-8009333d4081 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.039261 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-487f3d58-b1ca-46a4-9f3f-272ffd4f3bb2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:51.040491 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-487f3d58-b1ca-46a4-9f3f-272ffd4f3bb2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:51.046486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-487f3d58-b1ca-46a4-9f3f-272ffd4f3bb2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.046918 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-487f3d58-b1ca-46a4-9f3f-272ffd4f3bb2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.047695 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-487f3d58-b1ca-46a4-9f3f-272ffd4f3bb2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.048122 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-487f3d58-b1ca-46a4-9f3f-272ffd4f3bb2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.071361 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-487f3d58-b1ca-46a4-9f3f-272ffd4f3bb2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lazy-loading 'flavor' on Instance uuid 0d03f1de-078d-4fff-aec4-7c91aaaa1eed {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:27:51.105807 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fc764c1f-fa3d-418a-92ee-8009333d4081 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:51.113406 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-fc764c1f-fa3d-418a-92ee-8009333d4081 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.166114 Jan 28 20:27:51.113988 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 158/324] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:50 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:51.148768 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-487f3d58-b1ca-46a4-9f3f-272ffd4f3bb2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/action" status: 200 len: 32 microversion: 2.1 time: 0.113441 Jan 28 20:27:51.149615 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 167/325] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:27:51 2022] POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 20:27:51.164110 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-798e4392-f656-47fe-8cb9-f1e11f9b654a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:51.165030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-798e4392-f656-47fe-8cb9-f1e11f9b654a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:51.172209 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-798e4392-f656-47fe-8cb9-f1e11f9b654a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.172649 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-798e4392-f656-47fe-8cb9-f1e11f9b654a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.173710 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-798e4392-f656-47fe-8cb9-f1e11f9b654a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.174227 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-798e4392-f656-47fe-8cb9-f1e11f9b654a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.339786 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-798e4392-f656-47fe-8cb9-f1e11f9b654a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:51.355324 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-798e4392-f656-47fe-8cb9-f1e11f9b654a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.200335 Jan 28 20:27:51.356080 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 159/326] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:51 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:51.404165 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-a628a9d0-97a4-4b0b-b05e-7438c14e0606 req-38e74d02-5652-4139-a0b5-fbe0544729e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fe010b-84f6-4fd1-9b37-5a169df50bdd", "name": "network-vif-plugged", "status": "completed", "tag": "1a57cf51-27e2-4d5d-b600-5a463219e79e"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:51.406847 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:27:51.406847 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:27:51.420595 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-a628a9d0-97a4-4b0b-b05e-7438c14e0606 req-38e74d02-5652-4139-a0b5-fbe0544729e7 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.421039 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-a628a9d0-97a4-4b0b-b05e-7438c14e0606 req-38e74d02-5652-4139-a0b5-fbe0544729e7 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.433161 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-a628a9d0-97a4-4b0b-b05e-7438c14e0606 req-38e74d02-5652-4139-a0b5-fbe0544729e7 service nova] Creating event network-vif-plugged:1a57cf51-27e2-4d5d-b600-5a463219e79e for instance e7fe010b-84f6-4fd1-9b37-5a169df50bdd on hv-cinder-82635 Jan 28 20:27:51.442503 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8d0abe45-b9d1-4b39-aea3-18055cfd4dc8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:51.443109 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8d0abe45-b9d1-4b39-aea3-18055cfd4dc8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:51.447147 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-a628a9d0-97a4-4b0b-b05e-7438c14e0606 req-38e74d02-5652-4139-a0b5-fbe0544729e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047762 Jan 28 20:27:51.448117 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 168/327] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:27:51.449380 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8d0abe45-b9d1-4b39-aea3-18055cfd4dc8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.449938 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8d0abe45-b9d1-4b39-aea3-18055cfd4dc8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.450998 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8d0abe45-b9d1-4b39-aea3-18055cfd4dc8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.451890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8d0abe45-b9d1-4b39-aea3-18055cfd4dc8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.641945 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8d0abe45-b9d1-4b39-aea3-18055cfd4dc8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:51.650173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8d0abe45-b9d1-4b39-aea3-18055cfd4dc8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1508 microversion: 2.1 time: 0.211291 Jan 28 20:27:51.651191 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 160/328] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:51 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:51.681484 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-157e688c-2cc5-470d-b788-75e9545c97e2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "482afad1-3bd9-4b5c-8ac3-986bc5de338a"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:51.687425 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-157e688c-2cc5-470d-b788-75e9545c97e2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:51.696516 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-157e688c-2cc5-470d-b788-75e9545c97e2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.697204 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-157e688c-2cc5-470d-b788-75e9545c97e2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.699162 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-157e688c-2cc5-470d-b788-75e9545c97e2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.699613 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-157e688c-2cc5-470d-b788-75e9545c97e2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.817404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-157e688c-2cc5-470d-b788-75e9545c97e2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] HTTP exception thrown: Invalid volume: volume 482afad1-3bd9-4b5c-8ac3-986bc5de338a is already attached to instances: bf9d2426-a27b-4214-b459-f1431e8cd865 Jan 28 20:27:51.817785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-157e688c-2cc5-470d-b788-75e9545c97e2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Returning 400 to user: Invalid volume: volume 482afad1-3bd9-4b5c-8ac3-986bc5de338a is already attached to instances: bf9d2426-a27b-4214-b459-f1431e8cd865 {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:27:51.820064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-157e688c-2cc5-470d-b788-75e9545c97e2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "POST /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.148734 Jan 28 20:27:51.821235 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 169/329] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:27:51 2022] POST /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43/os-volume_attachments => generated 174 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 20:27:51.891066 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8ccab797-a39e-4f6d-9b59-0f55309b03ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:51.891561 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8ccab797-a39e-4f6d-9b59-0f55309b03ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:51.902094 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ccab797-a39e-4f6d-9b59-0f55309b03ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.902094 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ccab797-a39e-4f6d-9b59-0f55309b03ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:51.902094 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ccab797-a39e-4f6d-9b59-0f55309b03ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:51.902094 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ccab797-a39e-4f6d-9b59-0f55309b03ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:52.130069 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b865c5bf-d241-468e-b2b2-153a5ad2f28d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:52.130938 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b865c5bf-d241-468e-b2b2-153a5ad2f28d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:52.138229 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b865c5bf-d241-468e-b2b2-153a5ad2f28d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:52.138679 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b865c5bf-d241-468e-b2b2-153a5ad2f28d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:52.139741 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b865c5bf-d241-468e-b2b2-153a5ad2f28d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:52.140320 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b865c5bf-d241-468e-b2b2-153a5ad2f28d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:52.188773 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-8ccab797-a39e-4f6d-9b59-0f55309b03ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lazy-loading 'services' on Instance uuid bf9d2426-a27b-4214-b459-f1431e8cd865 {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:27:52.312601 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b865c5bf-d241-468e-b2b2-153a5ad2f28d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:52.323108 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8ccab797-a39e-4f6d-9b59-0f55309b03ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments/482afad1-3bd9-4b5c-8ac3-986bc5de338a" status: 202 len: 0 microversion: 2.1 time: 0.438873 Jan 28 20:27:52.323776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 161/330] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:27:51 2022] DELETE /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments/482afad1-3bd9-4b5c-8ac3-986bc5de338a => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:27:52.325906 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b865c5bf-d241-468e-b2b2-153a5ad2f28d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.199373 Jan 28 20:27:52.326557 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 170/331] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:52 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:52.332177 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-19d787be-2131-417f-b31e-060101905663 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:52.333299 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-19d787be-2131-417f-b31e-060101905663 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:52.340278 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19d787be-2131-417f-b31e-060101905663 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:52.340800 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19d787be-2131-417f-b31e-060101905663 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:52.341655 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19d787be-2131-417f-b31e-060101905663 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:52.342217 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19d787be-2131-417f-b31e-060101905663 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:52.373156 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-04271f2e-5260-41c7-b9c1-82fc7746f9f3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:52.374086 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-04271f2e-5260-41c7-b9c1-82fc7746f9f3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:52.381490 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-19d787be-2131-417f-b31e-060101905663 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053107 Jan 28 20:27:52.382236 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-04271f2e-5260-41c7-b9c1-82fc7746f9f3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:52.382496 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 162/332] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:27:52 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:27:52.383110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-04271f2e-5260-41c7-b9c1-82fc7746f9f3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:52.384036 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-04271f2e-5260-41c7-b9c1-82fc7746f9f3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:52.384562 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-04271f2e-5260-41c7-b9c1-82fc7746f9f3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:52.546923 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-04271f2e-5260-41c7-b9c1-82fc7746f9f3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:52.554724 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-04271f2e-5260-41c7-b9c1-82fc7746f9f3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.185681 Jan 28 20:27:52.555378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 171/333] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:52 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:53.343241 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ec5eb282-c39c-40ad-ae32-191553f9fff8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:53.343868 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ec5eb282-c39c-40ad-ae32-191553f9fff8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:53.349834 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ec5eb282-c39c-40ad-ae32-191553f9fff8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:53.350440 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ec5eb282-c39c-40ad-ae32-191553f9fff8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:53.351309 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ec5eb282-c39c-40ad-ae32-191553f9fff8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:53.351654 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ec5eb282-c39c-40ad-ae32-191553f9fff8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:53.392521 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-deb4c317-85c9-463d-ac88-a2970b06d53a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:53.393840 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-deb4c317-85c9-463d-ac88-a2970b06d53a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:53.402116 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-deb4c317-85c9-463d-ac88-a2970b06d53a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:53.402572 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-deb4c317-85c9-463d-ac88-a2970b06d53a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:53.403348 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-deb4c317-85c9-463d-ac88-a2970b06d53a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:53.403775 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-deb4c317-85c9-463d-ac88-a2970b06d53a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:53.457503 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-deb4c317-85c9-463d-ac88-a2970b06d53a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067313 Jan 28 20:27:53.462377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 172/334] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:27:53 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:27:53.530444 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ec5eb282-c39c-40ad-ae32-191553f9fff8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:53.538926 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ec5eb282-c39c-40ad-ae32-191553f9fff8 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1315 microversion: 2.1 time: 0.199555 Jan 28 20:27:53.550109 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 163/335] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:53 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:53.571380 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-143f9bf5-4c88-42d5-957c-5d7057a48a99 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:53.572289 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-143f9bf5-4c88-42d5-957c-5d7057a48a99 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:53.585680 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-143f9bf5-4c88-42d5-957c-5d7057a48a99 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:53.586680 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-143f9bf5-4c88-42d5-957c-5d7057a48a99 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:53.590653 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-143f9bf5-4c88-42d5-957c-5d7057a48a99 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:53.591373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-143f9bf5-4c88-42d5-957c-5d7057a48a99 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:53.793976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-143f9bf5-4c88-42d5-957c-5d7057a48a99 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:53.803625 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-143f9bf5-4c88-42d5-957c-5d7057a48a99 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.235904 Jan 28 20:27:53.805192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 173/336] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:53 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:54.469388 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-12842f01-da3d-4518-a055-b60ea718aa19 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:54.470523 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-12842f01-da3d-4518-a055-b60ea718aa19 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:54.476437 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-12842f01-da3d-4518-a055-b60ea718aa19 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:54.476954 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-12842f01-da3d-4518-a055-b60ea718aa19 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:54.477830 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-12842f01-da3d-4518-a055-b60ea718aa19 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:54.478492 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-12842f01-da3d-4518-a055-b60ea718aa19 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:54.512607 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-12842f01-da3d-4518-a055-b60ea718aa19 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047396 Jan 28 20:27:54.517526 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 164/337] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:27:54 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 20:27:54.557703 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9a8a32aa-a71e-47ef-944a-9c6a3a5b38a1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:54.558341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9a8a32aa-a71e-47ef-944a-9c6a3a5b38a1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:54.570616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9a8a32aa-a71e-47ef-944a-9c6a3a5b38a1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:54.571114 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9a8a32aa-a71e-47ef-944a-9c6a3a5b38a1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:54.572106 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9a8a32aa-a71e-47ef-944a-9c6a3a5b38a1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:54.575839 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9a8a32aa-a71e-47ef-944a-9c6a3a5b38a1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:54.719302 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2090434890", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "networks": [{"uuid": "f7cd137c-ce2e-4c82-9033-a14c7af1ce8b"}]}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:54.797834 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9a8a32aa-a71e-47ef-944a-9c6a3a5b38a1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:54.808431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9a8a32aa-a71e-47ef-944a-9c6a3a5b38a1 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1464 microversion: 2.1 time: 0.255768 Jan 28 20:27:54.809167 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 174/338] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:54 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1464 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:54.828675 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-db39f7d0-be71-4aad-aae0-2f62d0005bf5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:54.829613 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-db39f7d0-be71-4aad-aae0-2f62d0005bf5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:54.835652 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-db39f7d0-be71-4aad-aae0-2f62d0005bf5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:54.836096 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-db39f7d0-be71-4aad-aae0-2f62d0005bf5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:54.836875 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-db39f7d0-be71-4aad-aae0-2f62d0005bf5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:54.837303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-db39f7d0-be71-4aad-aae0-2f62d0005bf5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:55.007020 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-db39f7d0-be71-4aad-aae0-2f62d0005bf5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:55.017263 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-db39f7d0-be71-4aad-aae0-2f62d0005bf5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.193231 Jan 28 20:27:55.018179 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 175/339] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:54 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:55.022495 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-949cf166-a770-4549-891a-153381c3c5d6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:55.022983 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-949cf166-a770-4549-891a-153381c3c5d6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:55.029194 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-949cf166-a770-4549-891a-153381c3c5d6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:55.029928 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-949cf166-a770-4549-891a-153381c3c5d6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:55.030920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-949cf166-a770-4549-891a-153381c3c5d6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:55.031344 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-949cf166-a770-4549-891a-153381c3c5d6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:55.057902 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-949cf166-a770-4549-891a-153381c3c5d6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:27:55.158427 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-949cf166-a770-4549-891a-153381c3c5d6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 204 len: 0 microversion: 2.1 time: 0.138903 Jan 28 20:27:55.159224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 176/340] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:27:55 2022] DELETE /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:27:55.174384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-78391e5c-2097-41d4-ab7a-64fa8b93d87c tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:55.174384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-78391e5c-2097-41d4-ab7a-64fa8b93d87c tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:55.175393 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-78391e5c-2097-41d4-ab7a-64fa8b93d87c tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:55.175890 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-78391e5c-2097-41d4-ab7a-64fa8b93d87c tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:55.176669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-78391e5c-2097-41d4-ab7a-64fa8b93d87c tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:55.177116 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-78391e5c-2097-41d4-ab7a-64fa8b93d87c tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:55.330930 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-78391e5c-2097-41d4-ab7a-64fa8b93d87c tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:55.341658 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-78391e5c-2097-41d4-ab7a-64fa8b93d87c tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1470 microversion: 2.1 time: 0.177073 Jan 28 20:27:55.342460 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 177/341] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:55 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:56.035420 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2919a1af-cb18-4a66-8618-b38c925c9299 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:56.039680 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2919a1af-cb18-4a66-8618-b38c925c9299 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:56.048198 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2919a1af-cb18-4a66-8618-b38c925c9299 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:56.048928 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2919a1af-cb18-4a66-8618-b38c925c9299 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:56.049732 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2919a1af-cb18-4a66-8618-b38c925c9299 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:56.050207 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2919a1af-cb18-4a66-8618-b38c925c9299 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:56.212640 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2919a1af-cb18-4a66-8618-b38c925c9299 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:56.220347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2919a1af-cb18-4a66-8618-b38c925c9299 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.189146 Jan 28 20:27:56.221908 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 178/342] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:56 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:56.360182 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-61499c67-3912-44ea-b6dd-d80981ed585d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:56.360996 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-61499c67-3912-44ea-b6dd-d80981ed585d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:56.373111 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61499c67-3912-44ea-b6dd-d80981ed585d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:56.373426 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61499c67-3912-44ea-b6dd-d80981ed585d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:56.374260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61499c67-3912-44ea-b6dd-d80981ed585d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:56.374853 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61499c67-3912-44ea-b6dd-d80981ed585d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:56.626461 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-61499c67-3912-44ea-b6dd-d80981ed585d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:56.635061 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-61499c67-3912-44ea-b6dd-d80981ed585d tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1470 microversion: 2.1 time: 0.280031 Jan 28 20:27:56.636194 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 179/343] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:56 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:27:57.238414 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-5337443e-54d7-4a73-90c8-416a83732104 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:57.239101 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-5337443e-54d7-4a73-90c8-416a83732104 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:57.246072 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5337443e-54d7-4a73-90c8-416a83732104 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:57.246521 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5337443e-54d7-4a73-90c8-416a83732104 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:57.247301 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5337443e-54d7-4a73-90c8-416a83732104 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:57.247732 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5337443e-54d7-4a73-90c8-416a83732104 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:57.389072 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-5337443e-54d7-4a73-90c8-416a83732104 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:57.401582 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-5337443e-54d7-4a73-90c8-416a83732104 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.166046 Jan 28 20:27:57.402241 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 180/344] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:57 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:57.652178 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cd95dec9-2470-430f-a694-d2b7a1c048b6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:57.652776 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-cd95dec9-2470-430f-a694-d2b7a1c048b6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:57.658851 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cd95dec9-2470-430f-a694-d2b7a1c048b6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:57.659288 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cd95dec9-2470-430f-a694-d2b7a1c048b6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:57.660257 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cd95dec9-2470-430f-a694-d2b7a1c048b6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:57.660881 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cd95dec9-2470-430f-a694-d2b7a1c048b6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:57.880784 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cd95dec9-2470-430f-a694-d2b7a1c048b6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9677bb92c4049c79eb274649acbfccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a22c702c3fa4fcb93c739947f446def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:57.890036 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-cd95dec9-2470-430f-a694-d2b7a1c048b6 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 200 len: 1470 microversion: 2.1 time: 0.241359 Jan 28 20:27:57.890619 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 181/345] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:57 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 1470 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:57.913605 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-39d10da0-88c6-42f9-bcbe-dbf3d8e3ef41 req-de7d3b7b-c55f-420d-b874-b268bbafcd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fe010b-84f6-4fd1-9b37-5a169df50bdd", "name": "network-vif-deleted", "tag": "1a57cf51-27e2-4d5d-b600-5a463219e79e"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:27:57.916127 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:27:57.916127 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:27:57.937318 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-39d10da0-88c6-42f9-bcbe-dbf3d8e3ef41 req-de7d3b7b-c55f-420d-b874-b268bbafcd39 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:57.937997 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-39d10da0-88c6-42f9-bcbe-dbf3d8e3ef41 req-de7d3b7b-c55f-420d-b874-b268bbafcd39 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:57.950973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-39d10da0-88c6-42f9-bcbe-dbf3d8e3ef41 req-de7d3b7b-c55f-420d-b874-b268bbafcd39 service nova] Creating event network-vif-deleted:1a57cf51-27e2-4d5d-b600-5a463219e79e for instance e7fe010b-84f6-4fd1-9b37-5a169df50bdd on hv-cinder-82635 Jan 28 20:27:57.956861 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-39d10da0-88c6-42f9-bcbe-dbf3d8e3ef41 req-de7d3b7b-c55f-420d-b874-b268bbafcd39 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046705 Jan 28 20:27:57.958504 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 182/346] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:27:58.420690 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ff4af014-2637-4b27-8da2-da5cdfbe2945 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:58.421437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ff4af014-2637-4b27-8da2-da5cdfbe2945 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:58.427824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ff4af014-2637-4b27-8da2-da5cdfbe2945 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:58.428366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ff4af014-2637-4b27-8da2-da5cdfbe2945 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:58.429247 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ff4af014-2637-4b27-8da2-da5cdfbe2945 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:58.429764 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ff4af014-2637-4b27-8da2-da5cdfbe2945 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:58.592451 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ff4af014-2637-4b27-8da2-da5cdfbe2945 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:58.599565 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ff4af014-2637-4b27-8da2-da5cdfbe2945 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.184242 Jan 28 20:27:58.600138 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 183/347] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:58 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:27:58.907246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-aa04ce74-8415-4cb7-84a6-7f1c876fcb52 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:58.908323 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-aa04ce74-8415-4cb7-84a6-7f1c876fcb52 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] [instance: e7fe010b-84f6-4fd1-9b37-5a169df50bdd] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:58.914861 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-aa04ce74-8415-4cb7-84a6-7f1c876fcb52 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:58.915296 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-aa04ce74-8415-4cb7-84a6-7f1c876fcb52 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:58.916075 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-aa04ce74-8415-4cb7-84a6-7f1c876fcb52 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:58.917018 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-aa04ce74-8415-4cb7-84a6-7f1c876fcb52 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:58.930035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-aa04ce74-8415-4cb7-84a6-7f1c876fcb52 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] HTTP exception thrown: Instance e7fe010b-84f6-4fd1-9b37-5a169df50bdd could not be found. Jan 28 20:27:58.930616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-aa04ce74-8415-4cb7-84a6-7f1c876fcb52 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] Returning 404 to user: Instance e7fe010b-84f6-4fd1-9b37-5a169df50bdd could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:27:58.931486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-aa04ce74-8415-4cb7-84a6-7f1c876fcb52 tempest-VolumesNegativeTest-169238305 tempest-VolumesNegativeTest-169238305-project] 10.222.0.59 "GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd" status: 404 len: 111 microversion: 2.1 time: 0.028329 Jan 28 20:27:58.932771 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 184/348] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:58 2022] GET /compute/v2.1/servers/e7fe010b-84f6-4fd1-9b37-5a169df50bdd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 20:27:59.617340 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f1bcd399-1864-4274-877e-1b03890474fc tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:27:59.617969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f1bcd399-1864-4274-877e-1b03890474fc tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:27:59.623836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f1bcd399-1864-4274-877e-1b03890474fc tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:59.624301 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f1bcd399-1864-4274-877e-1b03890474fc tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:59.625072 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f1bcd399-1864-4274-877e-1b03890474fc tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:27:59.625501 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f1bcd399-1864-4274-877e-1b03890474fc tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:27:59.761395 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f1bcd399-1864-4274-877e-1b03890474fc tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:27:59.768571 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f1bcd399-1864-4274-877e-1b03890474fc tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.155506 Jan 28 20:27:59.769122 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 185/349] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:27:59 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:00.628735 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] validate_networks() for [('f7cd137c-ce2e-4c82-9033-a14c7af1ce8b', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:28:00.785836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7bca4e10-17aa-4e45-9580-b70d40fd8796 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:00.787207 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7bca4e10-17aa-4e45-9580-b70d40fd8796 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:00.795151 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7bca4e10-17aa-4e45-9580-b70d40fd8796 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:00.795827 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7bca4e10-17aa-4e45-9580-b70d40fd8796 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:00.796857 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7bca4e10-17aa-4e45-9580-b70d40fd8796 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:00.797324 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7bca4e10-17aa-4e45-9580-b70d40fd8796 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:01.046978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7bca4e10-17aa-4e45-9580-b70d40fd8796 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:01.060709 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7bca4e10-17aa-4e45-9580-b70d40fd8796 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.278373 Jan 28 20:28:01.061900 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 186/350] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:00 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:01.185915 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:28:01.186341 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:28:01.186801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:28:01.187206 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:28:01.187608 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:28:01.196287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:01.196730 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:01.197610 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:01.198650 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:01.218018 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Getting quotas for project d73cfa908e094fa0b8fbc1e550e29d20. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:28:01.222206 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Getting quotas for user 588b4e7353d2411ca853605fa586c8e8 and project d73cfa908e094fa0b8fbc1e550e29d20. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:28:01.235330 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:28:01.238055 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:28:01.288280 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7d15313f-d1a6-473a-b1d8-d5717ec99da9 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.574670 Jan 28 20:28:01.289221 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 165/351] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 6576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 20:28:01.299373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e0a3928a-6c60-4237-adf7-2a98418c85cb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:01.299989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e0a3928a-6c60-4237-adf7-2a98418c85cb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:01.358453 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e0a3928a-6c60-4237-adf7-2a98418c85cb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:01.365841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e0a3928a-6c60-4237-adf7-2a98418c85cb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1218 microversion: 2.1 time: 0.070315 Jan 28 20:28:01.366594 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 187/352] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:01 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:02.078112 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b67c2d48-d80a-49d6-9f02-00f28aa261ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:02.079333 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b67c2d48-d80a-49d6-9f02-00f28aa261ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:02.089611 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b67c2d48-d80a-49d6-9f02-00f28aa261ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:02.090166 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b67c2d48-d80a-49d6-9f02-00f28aa261ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:02.091088 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b67c2d48-d80a-49d6-9f02-00f28aa261ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:02.091573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b67c2d48-d80a-49d6-9f02-00f28aa261ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:02.233542 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b67c2d48-d80a-49d6-9f02-00f28aa261ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:02.244606 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b67c2d48-d80a-49d6-9f02-00f28aa261ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.170334 Jan 28 20:28:02.245216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 166/353] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:02 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:02.383887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-6677acc0-9166-4eec-9c33-4bd73e6edebf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:02.384818 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-6677acc0-9166-4eec-9c33-4bd73e6edebf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:02.393610 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6677acc0-9166-4eec-9c33-4bd73e6edebf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:02.395688 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6677acc0-9166-4eec-9c33-4bd73e6edebf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:02.396633 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6677acc0-9166-4eec-9c33-4bd73e6edebf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:02.397316 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6677acc0-9166-4eec-9c33-4bd73e6edebf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:02.495399 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-6677acc0-9166-4eec-9c33-4bd73e6edebf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:02.507424 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-6677acc0-9166-4eec-9c33-4bd73e6edebf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1278 microversion: 2.1 time: 0.127510 Jan 28 20:28:02.508430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 188/354] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:02 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:03.263131 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b8ed4b03-4f9b-431f-a9dd-19f49cdca79d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:03.264031 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b8ed4b03-4f9b-431f-a9dd-19f49cdca79d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:03.271049 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b8ed4b03-4f9b-431f-a9dd-19f49cdca79d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:03.271695 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b8ed4b03-4f9b-431f-a9dd-19f49cdca79d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:03.272580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b8ed4b03-4f9b-431f-a9dd-19f49cdca79d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:03.273115 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b8ed4b03-4f9b-431f-a9dd-19f49cdca79d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:03.521571 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b8ed4b03-4f9b-431f-a9dd-19f49cdca79d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:03.525943 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8e05016b-552d-4999-b9db-ba5f3772a613 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:03.527618 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8e05016b-552d-4999-b9db-ba5f3772a613 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:03.533307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b8ed4b03-4f9b-431f-a9dd-19f49cdca79d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.273758 Jan 28 20:28:03.533996 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 167/355] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:03 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:03.535621 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8e05016b-552d-4999-b9db-ba5f3772a613 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:03.536921 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8e05016b-552d-4999-b9db-ba5f3772a613 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:03.538016 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8e05016b-552d-4999-b9db-ba5f3772a613 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:03.538654 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8e05016b-552d-4999-b9db-ba5f3772a613 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:03.747559 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8e05016b-552d-4999-b9db-ba5f3772a613 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:03.755126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8e05016b-552d-4999-b9db-ba5f3772a613 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.233922 Jan 28 20:28:03.755882 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 189/356] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:03 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:04.330327 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-fead3a9f-2051-4a0b-93ca-df345b790d47 req-e31057a3-a569-4744-9b1a-4eacce0effb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb895887-c105-49c8-8ebb-6f2d7327a46c", "tag": "e0e35fd9-2a9a-446e-bf87-14668877b787"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:28:04.331900 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:28:04.331900 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:28:04.360515 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-fead3a9f-2051-4a0b-93ca-df345b790d47 req-e31057a3-a569-4744-9b1a-4eacce0effb2 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:04.361540 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-fead3a9f-2051-4a0b-93ca-df345b790d47 req-e31057a3-a569-4744-9b1a-4eacce0effb2 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:04.375744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-fead3a9f-2051-4a0b-93ca-df345b790d47 req-e31057a3-a569-4744-9b1a-4eacce0effb2 service nova] Creating event network-changed:e0e35fd9-2a9a-446e-bf87-14668877b787 for instance cb895887-c105-49c8-8ebb-6f2d7327a46c on hv-cinder-82635 Jan 28 20:28:04.381809 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-fead3a9f-2051-4a0b-93ca-df345b790d47 req-e31057a3-a569-4744-9b1a-4eacce0effb2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054566 Jan 28 20:28:04.382713 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 168/357] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:28:04.550781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-edff161d-055f-4b59-afe0-14df0961b425 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:04.552312 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-edff161d-055f-4b59-afe0-14df0961b425 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:04.564094 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-edff161d-055f-4b59-afe0-14df0961b425 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:04.565201 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-edff161d-055f-4b59-afe0-14df0961b425 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:04.566741 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-edff161d-055f-4b59-afe0-14df0961b425 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:04.568024 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-edff161d-055f-4b59-afe0-14df0961b425 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:04.725948 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-edff161d-055f-4b59-afe0-14df0961b425 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:04.733823 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-edff161d-055f-4b59-afe0-14df0961b425 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.187521 Jan 28 20:28:04.734436 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 190/358] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:04 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:04.780112 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-42c5f489-b018-4bb5-8a17-d2443f20d112 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:04.780740 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-42c5f489-b018-4bb5-8a17-d2443f20d112 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:04.786653 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-42c5f489-b018-4bb5-8a17-d2443f20d112 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:04.787097 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-42c5f489-b018-4bb5-8a17-d2443f20d112 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:04.787871 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-42c5f489-b018-4bb5-8a17-d2443f20d112 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:04.788299 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-42c5f489-b018-4bb5-8a17-d2443f20d112 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:04.924770 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-42c5f489-b018-4bb5-8a17-d2443f20d112 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:04.932463 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-42c5f489-b018-4bb5-8a17-d2443f20d112 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.156879 Jan 28 20:28:04.933131 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 169/359] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:04 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:05.749780 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-46aa4ca6-ec75-49fc-8d32-3f5c4a1d3cf3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:05.750412 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-46aa4ca6-ec75-49fc-8d32-3f5c4a1d3cf3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:05.756588 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-46aa4ca6-ec75-49fc-8d32-3f5c4a1d3cf3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:05.757022 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-46aa4ca6-ec75-49fc-8d32-3f5c4a1d3cf3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:05.757790 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-46aa4ca6-ec75-49fc-8d32-3f5c4a1d3cf3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:05.758306 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-46aa4ca6-ec75-49fc-8d32-3f5c4a1d3cf3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:05.897231 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-46aa4ca6-ec75-49fc-8d32-3f5c4a1d3cf3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:05.905752 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-46aa4ca6-ec75-49fc-8d32-3f5c4a1d3cf3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.159562 Jan 28 20:28:05.906516 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 191/360] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:05 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:05.948021 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8ba1b219-ef97-4510-961e-78ce635f6aa3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:05.948609 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8ba1b219-ef97-4510-961e-78ce635f6aa3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:05.954437 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ba1b219-ef97-4510-961e-78ce635f6aa3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:05.954881 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ba1b219-ef97-4510-961e-78ce635f6aa3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:05.955654 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ba1b219-ef97-4510-961e-78ce635f6aa3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:05.956083 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ba1b219-ef97-4510-961e-78ce635f6aa3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:06.096599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8ba1b219-ef97-4510-961e-78ce635f6aa3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:06.103805 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8ba1b219-ef97-4510-961e-78ce635f6aa3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.159365 Jan 28 20:28:06.104366 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 170/361] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:05 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:06.923005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ee01909d-f8ae-4338-9dc7-8be523d00af7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:06.923733 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ee01909d-f8ae-4338-9dc7-8be523d00af7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:06.929913 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee01909d-f8ae-4338-9dc7-8be523d00af7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:06.936989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee01909d-f8ae-4338-9dc7-8be523d00af7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:06.937814 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee01909d-f8ae-4338-9dc7-8be523d00af7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:06.938641 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee01909d-f8ae-4338-9dc7-8be523d00af7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:07.091340 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ee01909d-f8ae-4338-9dc7-8be523d00af7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:07.098807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ee01909d-f8ae-4338-9dc7-8be523d00af7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.179761 Jan 28 20:28:07.099380 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 192/362] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:06 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:07.121396 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e13359d6-9c87-4f01-9c07-4e001976f2b4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:07.122738 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e13359d6-9c87-4f01-9c07-4e001976f2b4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:07.129332 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e13359d6-9c87-4f01-9c07-4e001976f2b4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:07.129979 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e13359d6-9c87-4f01-9c07-4e001976f2b4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:07.130975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e13359d6-9c87-4f01-9c07-4e001976f2b4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:07.131653 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e13359d6-9c87-4f01-9c07-4e001976f2b4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:07.297833 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e13359d6-9c87-4f01-9c07-4e001976f2b4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:07.305716 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e13359d6-9c87-4f01-9c07-4e001976f2b4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.188920 Jan 28 20:28:07.306583 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 171/363] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:07 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:08.116275 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a984289f-bf63-45a2-a68d-9d3d017cfdfd tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:08.116907 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a984289f-bf63-45a2-a68d-9d3d017cfdfd tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:08.123870 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a984289f-bf63-45a2-a68d-9d3d017cfdfd tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:08.124311 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a984289f-bf63-45a2-a68d-9d3d017cfdfd tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:08.125120 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a984289f-bf63-45a2-a68d-9d3d017cfdfd tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:08.125551 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a984289f-bf63-45a2-a68d-9d3d017cfdfd tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:08.263273 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a984289f-bf63-45a2-a68d-9d3d017cfdfd tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:08.270561 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a984289f-bf63-45a2-a68d-9d3d017cfdfd tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.158286 Jan 28 20:28:08.271866 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 193/364] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:08 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:08.324687 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2a069c39-dc37-425f-8892-fc441050cd4c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:08.326164 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2a069c39-dc37-425f-8892-fc441050cd4c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:08.339939 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2a069c39-dc37-425f-8892-fc441050cd4c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:08.340630 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2a069c39-dc37-425f-8892-fc441050cd4c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:08.341729 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2a069c39-dc37-425f-8892-fc441050cd4c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:08.342407 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2a069c39-dc37-425f-8892-fc441050cd4c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:08.502056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2a069c39-dc37-425f-8892-fc441050cd4c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:08.510050 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2a069c39-dc37-425f-8892-fc441050cd4c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.190094 Jan 28 20:28:08.510921 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 172/365] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:08 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:09.287667 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2b8773fc-ad56-4778-8380-5baec77b465c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:09.288257 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2b8773fc-ad56-4778-8380-5baec77b465c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:09.296055 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2b8773fc-ad56-4778-8380-5baec77b465c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:09.296617 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2b8773fc-ad56-4778-8380-5baec77b465c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:09.297616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2b8773fc-ad56-4778-8380-5baec77b465c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:09.298225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2b8773fc-ad56-4778-8380-5baec77b465c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:09.527156 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2b8773fc-ad56-4778-8380-5baec77b465c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:09.531490 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a9f150f7-4ff9-48d0-8031-2fb7de2cc5ba tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:09.533054 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a9f150f7-4ff9-48d0-8031-2fb7de2cc5ba tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:09.535905 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2b8773fc-ad56-4778-8380-5baec77b465c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.251498 Jan 28 20:28:09.536577 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 194/366] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:09 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:09.542061 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a9f150f7-4ff9-48d0-8031-2fb7de2cc5ba tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:09.543175 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a9f150f7-4ff9-48d0-8031-2fb7de2cc5ba tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:09.544121 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a9f150f7-4ff9-48d0-8031-2fb7de2cc5ba tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:09.544639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a9f150f7-4ff9-48d0-8031-2fb7de2cc5ba tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:09.800752 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a9f150f7-4ff9-48d0-8031-2fb7de2cc5ba tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:09.812973 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a9f150f7-4ff9-48d0-8031-2fb7de2cc5ba tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.284069 Jan 28 20:28:09.817596 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 173/367] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:09 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:10.554194 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-559cdacc-8d0c-4a6b-8487-f5a2ec909d4d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:10.554821 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-559cdacc-8d0c-4a6b-8487-f5a2ec909d4d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:10.561494 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-559cdacc-8d0c-4a6b-8487-f5a2ec909d4d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:10.561968 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-559cdacc-8d0c-4a6b-8487-f5a2ec909d4d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:10.562770 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-559cdacc-8d0c-4a6b-8487-f5a2ec909d4d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:10.563200 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-559cdacc-8d0c-4a6b-8487-f5a2ec909d4d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:10.828880 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dfb8ece3-e901-4765-a049-a53a224534d0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:10.829980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dfb8ece3-e901-4765-a049-a53a224534d0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:10.837437 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dfb8ece3-e901-4765-a049-a53a224534d0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:10.838271 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dfb8ece3-e901-4765-a049-a53a224534d0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:10.839292 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dfb8ece3-e901-4765-a049-a53a224534d0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:10.840099 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dfb8ece3-e901-4765-a049-a53a224534d0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:10.847568 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-559cdacc-8d0c-4a6b-8487-f5a2ec909d4d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:10.860903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-559cdacc-8d0c-4a6b-8487-f5a2ec909d4d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.309036 Jan 28 20:28:10.863208 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 195/368] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:10 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:11.003999 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dfb8ece3-e901-4765-a049-a53a224534d0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:11.011563 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dfb8ece3-e901-4765-a049-a53a224534d0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.186337 Jan 28 20:28:11.012417 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 174/369] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:10 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:11.878180 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e257d2d8-840d-4f62-8762-fe2529101871 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:11.879437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e257d2d8-840d-4f62-8762-fe2529101871 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:11.886049 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e257d2d8-840d-4f62-8762-fe2529101871 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:11.886717 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e257d2d8-840d-4f62-8762-fe2529101871 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:11.888125 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e257d2d8-840d-4f62-8762-fe2529101871 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:11.888567 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e257d2d8-840d-4f62-8762-fe2529101871 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:12.028615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b276f1d2-9645-41b1-b7c5-86f117a15612 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:12.029488 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b276f1d2-9645-41b1-b7c5-86f117a15612 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:12.042381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b276f1d2-9645-41b1-b7c5-86f117a15612 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:12.042926 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b276f1d2-9645-41b1-b7c5-86f117a15612 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:12.046702 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b276f1d2-9645-41b1-b7c5-86f117a15612 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:12.047170 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b276f1d2-9645-41b1-b7c5-86f117a15612 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:12.125806 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e257d2d8-840d-4f62-8762-fe2529101871 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:12.134062 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e257d2d8-840d-4f62-8762-fe2529101871 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.259737 Jan 28 20:28:12.134973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 196/370] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:11 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:12.361602 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b276f1d2-9645-41b1-b7c5-86f117a15612 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:12.369066 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b276f1d2-9645-41b1-b7c5-86f117a15612 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.344372 Jan 28 20:28:12.370279 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 175/371] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:12 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:13.153128 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-37239a3d-6174-4c52-afa7-95305e8f4168 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:13.154603 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-37239a3d-6174-4c52-afa7-95305e8f4168 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:13.163094 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-37239a3d-6174-4c52-afa7-95305e8f4168 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:13.163742 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-37239a3d-6174-4c52-afa7-95305e8f4168 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:13.165061 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-37239a3d-6174-4c52-afa7-95305e8f4168 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:13.165650 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-37239a3d-6174-4c52-afa7-95305e8f4168 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:13.391838 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5db51952-9c08-4311-8377-8ffeb1f4fcb7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:13.393499 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5db51952-9c08-4311-8377-8ffeb1f4fcb7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:13.403940 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5db51952-9c08-4311-8377-8ffeb1f4fcb7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:13.406736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5db51952-9c08-4311-8377-8ffeb1f4fcb7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:13.408109 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5db51952-9c08-4311-8377-8ffeb1f4fcb7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:13.408723 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5db51952-9c08-4311-8377-8ffeb1f4fcb7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:13.825240 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5db51952-9c08-4311-8377-8ffeb1f4fcb7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:13.826976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-37239a3d-6174-4c52-afa7-95305e8f4168 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:13.834553 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5db51952-9c08-4311-8377-8ffeb1f4fcb7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.446793 Jan 28 20:28:13.835136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 176/372] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:13 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:13.862739 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-37239a3d-6174-4c52-afa7-95305e8f4168 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.708794 Jan 28 20:28:13.863406 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 197/373] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:13 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:14.853201 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0b1d6cf3-82f4-4137-99b1-da8e724247a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:14.854550 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0b1d6cf3-82f4-4137-99b1-da8e724247a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:14.870032 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0b1d6cf3-82f4-4137-99b1-da8e724247a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:14.870790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0b1d6cf3-82f4-4137-99b1-da8e724247a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:14.873547 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0b1d6cf3-82f4-4137-99b1-da8e724247a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:14.877625 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0b1d6cf3-82f4-4137-99b1-da8e724247a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:14.880080 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-16d0cca4-5fc9-44d5-a939-a76b73874efe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:14.880688 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-16d0cca4-5fc9-44d5-a939-a76b73874efe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:14.891618 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-16d0cca4-5fc9-44d5-a939-a76b73874efe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:14.893868 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-16d0cca4-5fc9-44d5-a939-a76b73874efe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:14.895157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-16d0cca4-5fc9-44d5-a939-a76b73874efe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:14.899200 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-16d0cca4-5fc9-44d5-a939-a76b73874efe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:15.308217 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-0b1d6cf3-82f4-4137-99b1-da8e724247a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:15.327589 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0b1d6cf3-82f4-4137-99b1-da8e724247a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.479159 Jan 28 20:28:15.329078 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-16d0cca4-5fc9-44d5-a939-a76b73874efe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:15.336808 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-16d0cca4-5fc9-44d5-a939-a76b73874efe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.460387 Jan 28 20:28:15.338708 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 198/374] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:14 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:15.350196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 177/375] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:14 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:16.357641 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7b3c0e7d-0a87-4e98-8823-7e196a1f8e31 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:16.359425 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7b3c0e7d-0a87-4e98-8823-7e196a1f8e31 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:16.370285 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-364c4132-6594-423a-bc57-8a4dde6842f2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:16.371471 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-364c4132-6594-423a-bc57-8a4dde6842f2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:16.383567 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-364c4132-6594-423a-bc57-8a4dde6842f2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:16.384019 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-364c4132-6594-423a-bc57-8a4dde6842f2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:16.385387 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-364c4132-6594-423a-bc57-8a4dde6842f2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:16.385828 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-364c4132-6594-423a-bc57-8a4dde6842f2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:16.389976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7b3c0e7d-0a87-4e98-8823-7e196a1f8e31 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:16.390514 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7b3c0e7d-0a87-4e98-8823-7e196a1f8e31 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:16.391360 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7b3c0e7d-0a87-4e98-8823-7e196a1f8e31 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:16.391792 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7b3c0e7d-0a87-4e98-8823-7e196a1f8e31 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:16.637008 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-364c4132-6594-423a-bc57-8a4dde6842f2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:16.647552 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-364c4132-6594-423a-bc57-8a4dde6842f2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.284348 Jan 28 20:28:16.648330 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 178/376] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:16 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:16.659550 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7b3c0e7d-0a87-4e98-8823-7e196a1f8e31 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:16.667617 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7b3c0e7d-0a87-4e98-8823-7e196a1f8e31 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.314957 Jan 28 20:28:16.668193 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 199/377] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:16 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:16.813044 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6df538c2-138d-4cc1-bb6c-723242ca656f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Action: 'create', calling method: .version_select at 0x7fc7798dfca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1067414585"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:28:16.826891 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-6df538c2-138d-4cc1-bb6c-723242ca656f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:28:16.830845 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-6df538c2-138d-4cc1-bb6c-723242ca656f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for user daa1f16966e94f0fb861bf124bbc0aac and project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:28:17.005024 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-6df538c2-138d-4cc1-bb6c-723242ca656f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:28:17.008850 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-6df538c2-138d-4cc1-bb6c-723242ca656f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for user daa1f16966e94f0fb861bf124bbc0aac and project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:28:17.021419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6df538c2-138d-4cc1-bb6c-723242ca656f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.371969 Jan 28 20:28:17.022118 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 179/378] 10.222.0.59 () {60 vars in 1157 bytes} [Fri Jan 28 20:28:16 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:17.664461 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a69766c7-5fdb-4c15-8990-1c66903288a4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:17.665087 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a69766c7-5fdb-4c15-8990-1c66903288a4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:17.672641 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a69766c7-5fdb-4c15-8990-1c66903288a4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:17.673268 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a69766c7-5fdb-4c15-8990-1c66903288a4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:17.674260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a69766c7-5fdb-4c15-8990-1c66903288a4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:17.674694 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a69766c7-5fdb-4c15-8990-1c66903288a4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:17.684959 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3d0470ba-6042-4ef6-b8af-edbe26d1897b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:17.685597 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3d0470ba-6042-4ef6-b8af-edbe26d1897b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:17.695170 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3d0470ba-6042-4ef6-b8af-edbe26d1897b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:17.695620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3d0470ba-6042-4ef6-b8af-edbe26d1897b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:17.696418 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3d0470ba-6042-4ef6-b8af-edbe26d1897b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:17.697242 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3d0470ba-6042-4ef6-b8af-edbe26d1897b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:17.991553 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3d0470ba-6042-4ef6-b8af-edbe26d1897b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:17.992731 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a69766c7-5fdb-4c15-8990-1c66903288a4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:18.001507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a69766c7-5fdb-4c15-8990-1c66903288a4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.340732 Jan 28 20:28:18.002569 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 200/379] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:17 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:18.003248 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3d0470ba-6042-4ef6-b8af-edbe26d1897b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.322099 Jan 28 20:28:18.003819 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 180/380] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:17 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:19.022211 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5554965a-4928-4e32-888d-6b8efeb7c82c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:19.022211 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5554965a-4928-4e32-888d-6b8efeb7c82c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:19.023989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a9c68759-d146-4df3-973f-948f690c2fc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:19.024591 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a9c68759-d146-4df3-973f-948f690c2fc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:19.033638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5554965a-4928-4e32-888d-6b8efeb7c82c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:19.033781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a9c68759-d146-4df3-973f-948f690c2fc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:19.034146 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a9c68759-d146-4df3-973f-948f690c2fc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:19.034260 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5554965a-4928-4e32-888d-6b8efeb7c82c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:19.034932 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a9c68759-d146-4df3-973f-948f690c2fc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:19.035361 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a9c68759-d146-4df3-973f-948f690c2fc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:19.035469 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5554965a-4928-4e32-888d-6b8efeb7c82c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:19.035946 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5554965a-4928-4e32-888d-6b8efeb7c82c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:19.270898 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a9c68759-d146-4df3-973f-948f690c2fc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:19.277411 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5554965a-4928-4e32-888d-6b8efeb7c82c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:19.285325 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5554965a-4928-4e32-888d-6b8efeb7c82c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.267783 Jan 28 20:28:19.285917 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 181/381] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:19 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:19.293082 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a9c68759-d146-4df3-973f-948f690c2fc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.277957 Jan 28 20:28:19.295146 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 201/382] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:19 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:20.302506 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7f9b5c92-50c3-43c2-937b-124a23612c67 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:20.303107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7f9b5c92-50c3-43c2-937b-124a23612c67 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:20.308964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f9b5c92-50c3-43c2-937b-124a23612c67 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:20.309581 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f9b5c92-50c3-43c2-937b-124a23612c67 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:20.310455 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f9b5c92-50c3-43c2-937b-124a23612c67 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:20.310888 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f9b5c92-50c3-43c2-937b-124a23612c67 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:20.315530 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-854d690e-7cc1-4062-9097-1e238216fa6f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:20.316135 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-854d690e-7cc1-4062-9097-1e238216fa6f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:20.322782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-854d690e-7cc1-4062-9097-1e238216fa6f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:20.323220 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-854d690e-7cc1-4062-9097-1e238216fa6f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:20.323995 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-854d690e-7cc1-4062-9097-1e238216fa6f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:20.324421 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-854d690e-7cc1-4062-9097-1e238216fa6f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:20.586433 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7f9b5c92-50c3-43c2-937b-124a23612c67 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:20.604649 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7f9b5c92-50c3-43c2-937b-124a23612c67 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.302519 Jan 28 20:28:20.625347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 182/383] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:20 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:20.631296 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-854d690e-7cc1-4062-9097-1e238216fa6f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:20.640128 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-854d690e-7cc1-4062-9097-1e238216fa6f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.328230 Jan 28 20:28:20.640707 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 202/384] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:20 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:21.635455 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d5f9b4ab-f051-4902-bf70-c7a4541449eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:21.637741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d5f9b4ab-f051-4902-bf70-c7a4541449eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:21.644467 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d5f9b4ab-f051-4902-bf70-c7a4541449eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:21.645677 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d5f9b4ab-f051-4902-bf70-c7a4541449eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:21.646670 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d5f9b4ab-f051-4902-bf70-c7a4541449eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:21.647110 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d5f9b4ab-f051-4902-bf70-c7a4541449eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:21.657422 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-55b085cb-b7a8-4444-8430-2c842c0eb742 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:21.659267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-55b085cb-b7a8-4444-8430-2c842c0eb742 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:21.666477 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-55b085cb-b7a8-4444-8430-2c842c0eb742 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:21.667410 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-55b085cb-b7a8-4444-8430-2c842c0eb742 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:21.668463 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-55b085cb-b7a8-4444-8430-2c842c0eb742 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:21.669288 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-55b085cb-b7a8-4444-8430-2c842c0eb742 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:21.868911 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d5f9b4ab-f051-4902-bf70-c7a4541449eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:21.876248 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d5f9b4ab-f051-4902-bf70-c7a4541449eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.249091 Jan 28 20:28:21.876804 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 183/385] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:21 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:21.894873 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-55b085cb-b7a8-4444-8430-2c842c0eb742 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:21.902894 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-55b085cb-b7a8-4444-8430-2c842c0eb742 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.249638 Jan 28 20:28:21.903457 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 203/386] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:21 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:22.893704 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8351b25c-150e-4032-ae2b-5c50b89c1e24 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:22.894366 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8351b25c-150e-4032-ae2b-5c50b89c1e24 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:22.900892 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8351b25c-150e-4032-ae2b-5c50b89c1e24 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:22.901363 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8351b25c-150e-4032-ae2b-5c50b89c1e24 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:22.902165 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8351b25c-150e-4032-ae2b-5c50b89c1e24 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:22.902598 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8351b25c-150e-4032-ae2b-5c50b89c1e24 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:22.921902 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4ac0d3c2-d9e2-4afe-a6b2-c36cc1aac469 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:22.923036 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4ac0d3c2-d9e2-4afe-a6b2-c36cc1aac469 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:22.929550 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ac0d3c2-d9e2-4afe-a6b2-c36cc1aac469 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:22.930014 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ac0d3c2-d9e2-4afe-a6b2-c36cc1aac469 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:22.930803 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ac0d3c2-d9e2-4afe-a6b2-c36cc1aac469 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:22.931232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ac0d3c2-d9e2-4afe-a6b2-c36cc1aac469 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:23.103210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8351b25c-150e-4032-ae2b-5c50b89c1e24 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:23.111259 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8351b25c-150e-4032-ae2b-5c50b89c1e24 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.221155 Jan 28 20:28:23.112006 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 184/387] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:22 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:23.128366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4ac0d3c2-d9e2-4afe-a6b2-c36cc1aac469 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:23.136609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4ac0d3c2-d9e2-4afe-a6b2-c36cc1aac469 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.220746 Jan 28 20:28:23.137361 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 204/388] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:22 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:24.128353 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cb07cf90-d9d8-4552-bf45-478bb331493a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:24.128952 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cb07cf90-d9d8-4552-bf45-478bb331493a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:24.134878 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb07cf90-d9d8-4552-bf45-478bb331493a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:24.135319 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb07cf90-d9d8-4552-bf45-478bb331493a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:24.136083 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb07cf90-d9d8-4552-bf45-478bb331493a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:24.136512 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb07cf90-d9d8-4552-bf45-478bb331493a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:24.152727 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8c5961a3-8fe6-4588-84ed-931f2653687a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:24.153627 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8c5961a3-8fe6-4588-84ed-931f2653687a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:24.160174 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c5961a3-8fe6-4588-84ed-931f2653687a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:24.160708 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c5961a3-8fe6-4588-84ed-931f2653687a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:24.161556 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c5961a3-8fe6-4588-84ed-931f2653687a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:24.162107 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c5961a3-8fe6-4588-84ed-931f2653687a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:24.331145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-cb07cf90-d9d8-4552-bf45-478bb331493a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:24.339700 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cb07cf90-d9d8-4552-bf45-478bb331493a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.215235 Jan 28 20:28:24.340283 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 185/389] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:24 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:24.355738 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8c5961a3-8fe6-4588-84ed-931f2653687a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:24.363614 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8c5961a3-8fe6-4588-84ed-931f2653687a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.214943 Jan 28 20:28:24.364199 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 205/390] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:24 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:25.359717 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5e8c4e01-f1c0-4e9b-b84f-91a1920213ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:25.360326 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5e8c4e01-f1c0-4e9b-b84f-91a1920213ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:25.366298 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5e8c4e01-f1c0-4e9b-b84f-91a1920213ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:25.366738 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5e8c4e01-f1c0-4e9b-b84f-91a1920213ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:25.367511 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5e8c4e01-f1c0-4e9b-b84f-91a1920213ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:25.367936 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5e8c4e01-f1c0-4e9b-b84f-91a1920213ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:25.380974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-298cb81c-73ab-432b-89e0-ac12c97d97ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:25.381571 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-298cb81c-73ab-432b-89e0-ac12c97d97ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:25.388027 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-298cb81c-73ab-432b-89e0-ac12c97d97ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:25.388472 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-298cb81c-73ab-432b-89e0-ac12c97d97ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:25.389282 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-298cb81c-73ab-432b-89e0-ac12c97d97ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:25.389749 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-298cb81c-73ab-432b-89e0-ac12c97d97ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:25.583356 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5e8c4e01-f1c0-4e9b-b84f-91a1920213ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:25.586599 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-298cb81c-73ab-432b-89e0-ac12c97d97ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:25.591449 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5e8c4e01-f1c0-4e9b-b84f-91a1920213ef tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.236794 Jan 28 20:28:25.592888 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 186/391] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:25 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:25.594143 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-298cb81c-73ab-432b-89e0-ac12c97d97ae tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.217028 Jan 28 20:28:25.594696 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 206/392] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:25 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:26.608696 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b0cf1d9c-a2bb-4525-97ad-3ed5a0d0fb8f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:26.609518 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b0cf1d9c-a2bb-4525-97ad-3ed5a0d0fb8f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:26.611116 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d0072340-663a-4462-bc46-c2e6f7182892 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:26.611916 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d0072340-663a-4462-bc46-c2e6f7182892 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:26.615477 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b0cf1d9c-a2bb-4525-97ad-3ed5a0d0fb8f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:26.615923 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b0cf1d9c-a2bb-4525-97ad-3ed5a0d0fb8f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:26.616692 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b0cf1d9c-a2bb-4525-97ad-3ed5a0d0fb8f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:26.617122 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b0cf1d9c-a2bb-4525-97ad-3ed5a0d0fb8f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:26.618259 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d0072340-663a-4462-bc46-c2e6f7182892 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:26.618697 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d0072340-663a-4462-bc46-c2e6f7182892 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:26.619970 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d0072340-663a-4462-bc46-c2e6f7182892 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:26.620393 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d0072340-663a-4462-bc46-c2e6f7182892 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:27.023302 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b0cf1d9c-a2bb-4525-97ad-3ed5a0d0fb8f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:27.026554 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d0072340-663a-4462-bc46-c2e6f7182892 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:27.031737 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b0cf1d9c-a2bb-4525-97ad-3ed5a0d0fb8f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.426955 Jan 28 20:28:27.032243 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 187/393] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:26 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:27.035641 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d0072340-663a-4462-bc46-c2e6f7182892 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.428350 Jan 28 20:28:27.036297 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 207/394] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:26 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:28.048186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a45e9a2f-92e0-42f7-98e1-83f7b958d6be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:28.048788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a45e9a2f-92e0-42f7-98e1-83f7b958d6be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:28.052107 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2b371720-d3fd-43b0-82c6-247b028f53ec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:28.052718 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2b371720-d3fd-43b0-82c6-247b028f53ec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:28.054641 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a45e9a2f-92e0-42f7-98e1-83f7b958d6be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:28.055106 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a45e9a2f-92e0-42f7-98e1-83f7b958d6be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:28.056088 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a45e9a2f-92e0-42f7-98e1-83f7b958d6be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:28.057278 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a45e9a2f-92e0-42f7-98e1-83f7b958d6be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:28.059781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2b371720-d3fd-43b0-82c6-247b028f53ec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:28.060227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2b371720-d3fd-43b0-82c6-247b028f53ec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:28.061024 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2b371720-d3fd-43b0-82c6-247b028f53ec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:28.061455 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2b371720-d3fd-43b0-82c6-247b028f53ec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:28.253284 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2b371720-d3fd-43b0-82c6-247b028f53ec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:28.257231 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a45e9a2f-92e0-42f7-98e1-83f7b958d6be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:28.262319 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2b371720-d3fd-43b0-82c6-247b028f53ec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.213749 Jan 28 20:28:28.262905 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 208/395] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:28 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:28.265474 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a45e9a2f-92e0-42f7-98e1-83f7b958d6be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.221089 Jan 28 20:28:28.266043 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 188/396] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:28 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:29.279818 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-563e6497-e693-4e9f-93cb-a47356857fec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:29.280759 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-563e6497-e693-4e9f-93cb-a47356857fec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:29.282805 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dc079bb1-9fb0-4b95-bd08-88bb22cb2959 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:29.283500 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dc079bb1-9fb0-4b95-bd08-88bb22cb2959 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:29.287312 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-563e6497-e693-4e9f-93cb-a47356857fec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:29.287758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-563e6497-e693-4e9f-93cb-a47356857fec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:29.288542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-563e6497-e693-4e9f-93cb-a47356857fec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:29.288969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-563e6497-e693-4e9f-93cb-a47356857fec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:29.289661 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc079bb1-9fb0-4b95-bd08-88bb22cb2959 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:29.290157 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc079bb1-9fb0-4b95-bd08-88bb22cb2959 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:29.290926 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc079bb1-9fb0-4b95-bd08-88bb22cb2959 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:29.291351 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc079bb1-9fb0-4b95-bd08-88bb22cb2959 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:29.489678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-563e6497-e693-4e9f-93cb-a47356857fec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:29.497748 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dc079bb1-9fb0-4b95-bd08-88bb22cb2959 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:29.498950 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-563e6497-e693-4e9f-93cb-a47356857fec tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.223416 Jan 28 20:28:29.499636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 209/397] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:29 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:29.505524 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dc079bb1-9fb0-4b95-bd08-88bb22cb2959 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.227117 Jan 28 20:28:29.506113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 189/398] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:29 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:30.514556 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-08b2c83d-aa12-46bc-9cbd-1c9e8f0c21e4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:30.515159 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-08b2c83d-aa12-46bc-9cbd-1c9e8f0c21e4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:30.521697 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08b2c83d-aa12-46bc-9cbd-1c9e8f0c21e4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:30.522173 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08b2c83d-aa12-46bc-9cbd-1c9e8f0c21e4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:30.522310 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-76a07480-726d-4897-8035-afcf4093a3eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:30.522851 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-76a07480-726d-4897-8035-afcf4093a3eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:30.522946 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08b2c83d-aa12-46bc-9cbd-1c9e8f0c21e4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:30.523361 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08b2c83d-aa12-46bc-9cbd-1c9e8f0c21e4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:30.530600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-76a07480-726d-4897-8035-afcf4093a3eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:30.530600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-76a07480-726d-4897-8035-afcf4093a3eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:30.530600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-76a07480-726d-4897-8035-afcf4093a3eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:30.530931 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-76a07480-726d-4897-8035-afcf4093a3eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:30.730732 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-08b2c83d-aa12-46bc-9cbd-1c9e8f0c21e4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:30.733673 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-76a07480-726d-4897-8035-afcf4093a3eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:30.738433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-08b2c83d-aa12-46bc-9cbd-1c9e8f0c21e4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.227323 Jan 28 20:28:30.738942 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 210/399] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:30 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:30.741694 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-76a07480-726d-4897-8035-afcf4093a3eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.222972 Jan 28 20:28:30.742337 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 190/400] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:30 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:31.755061 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-702a9bd6-8a1b-488f-bdaa-553b1d252c99 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:31.755585 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-702a9bd6-8a1b-488f-bdaa-553b1d252c99 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:31.757955 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b6d2178b-39c3-4b3a-abf8-618695485785 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:31.758563 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b6d2178b-39c3-4b3a-abf8-618695485785 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:31.761892 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-702a9bd6-8a1b-488f-bdaa-553b1d252c99 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:31.762345 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-702a9bd6-8a1b-488f-bdaa-553b1d252c99 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:31.763121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-702a9bd6-8a1b-488f-bdaa-553b1d252c99 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:31.763545 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-702a9bd6-8a1b-488f-bdaa-553b1d252c99 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:31.764266 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b6d2178b-39c3-4b3a-abf8-618695485785 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:31.764717 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b6d2178b-39c3-4b3a-abf8-618695485785 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:31.765491 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b6d2178b-39c3-4b3a-abf8-618695485785 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:31.765974 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b6d2178b-39c3-4b3a-abf8-618695485785 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:31.957558 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-702a9bd6-8a1b-488f-bdaa-553b1d252c99 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:31.961315 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b6d2178b-39c3-4b3a-abf8-618695485785 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:31.966404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-702a9bd6-8a1b-488f-bdaa-553b1d252c99 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.214982 Jan 28 20:28:31.967141 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 211/401] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:31 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:31.969637 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b6d2178b-39c3-4b3a-abf8-618695485785 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.215175 Jan 28 20:28:31.970226 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 191/402] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:31 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:32.982826 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-5528c10c-96ce-48dd-aa9a-e9bc86782c90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:32.983437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-5528c10c-96ce-48dd-aa9a-e9bc86782c90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:32.993448 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d57c8ff5-c218-435a-bd90-b546b1b5bd3f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:32.993448 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d57c8ff5-c218-435a-bd90-b546b1b5bd3f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:32.993969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5528c10c-96ce-48dd-aa9a-e9bc86782c90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:32.993969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5528c10c-96ce-48dd-aa9a-e9bc86782c90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:32.993969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5528c10c-96ce-48dd-aa9a-e9bc86782c90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:32.993969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5528c10c-96ce-48dd-aa9a-e9bc86782c90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:32.995739 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d57c8ff5-c218-435a-bd90-b546b1b5bd3f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:32.996249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d57c8ff5-c218-435a-bd90-b546b1b5bd3f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:32.997225 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d57c8ff5-c218-435a-bd90-b546b1b5bd3f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:32.997732 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d57c8ff5-c218-435a-bd90-b546b1b5bd3f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:33.190972 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d57c8ff5-c218-435a-bd90-b546b1b5bd3f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:33.195116 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-5528c10c-96ce-48dd-aa9a-e9bc86782c90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:33.199890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d57c8ff5-c218-435a-bd90-b546b1b5bd3f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.215375 Jan 28 20:28:33.200472 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 192/403] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:32 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:33.204226 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-5528c10c-96ce-48dd-aa9a-e9bc86782c90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.225123 Jan 28 20:28:33.204786 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 212/404] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:32 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:34.216400 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-41fdbda3-7b20-4760-bad8-f44c6febd3f2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:34.216999 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-41fdbda3-7b20-4760-bad8-f44c6febd3f2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:34.219968 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b7b81f8f-ee27-4c97-a62f-67455d9f80a0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:34.220570 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b7b81f8f-ee27-4c97-a62f-67455d9f80a0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:34.223151 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41fdbda3-7b20-4760-bad8-f44c6febd3f2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:34.223602 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41fdbda3-7b20-4760-bad8-f44c6febd3f2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:34.224376 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41fdbda3-7b20-4760-bad8-f44c6febd3f2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:34.224799 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41fdbda3-7b20-4760-bad8-f44c6febd3f2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:34.226810 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b7b81f8f-ee27-4c97-a62f-67455d9f80a0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:34.227249 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b7b81f8f-ee27-4c97-a62f-67455d9f80a0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:34.228021 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b7b81f8f-ee27-4c97-a62f-67455d9f80a0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:34.228444 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b7b81f8f-ee27-4c97-a62f-67455d9f80a0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:34.429217 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-41fdbda3-7b20-4760-bad8-f44c6febd3f2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:34.437170 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-41fdbda3-7b20-4760-bad8-f44c6febd3f2 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.224394 Jan 28 20:28:34.437744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 193/405] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:34 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:34.441413 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b7b81f8f-ee27-4c97-a62f-67455d9f80a0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:34.449165 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b7b81f8f-ee27-4c97-a62f-67455d9f80a0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.232407 Jan 28 20:28:34.450206 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 213/406] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:34 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:35.453744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-55711060-1b43-4561-a340-8a3bb8aede3c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:35.454418 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-55711060-1b43-4561-a340-8a3bb8aede3c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:35.460317 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-55711060-1b43-4561-a340-8a3bb8aede3c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:35.460762 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-55711060-1b43-4561-a340-8a3bb8aede3c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:35.461536 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-55711060-1b43-4561-a340-8a3bb8aede3c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:35.461992 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-55711060-1b43-4561-a340-8a3bb8aede3c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:35.466030 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3a745f1b-1892-4ca6-9ddf-efeeb9ce7185 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:35.466648 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3a745f1b-1892-4ca6-9ddf-efeeb9ce7185 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:35.472770 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a745f1b-1892-4ca6-9ddf-efeeb9ce7185 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:35.473303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a745f1b-1892-4ca6-9ddf-efeeb9ce7185 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:35.474123 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a745f1b-1892-4ca6-9ddf-efeeb9ce7185 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:35.474556 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3a745f1b-1892-4ca6-9ddf-efeeb9ce7185 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:35.662931 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-55711060-1b43-4561-a340-8a3bb8aede3c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:35.665957 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3a745f1b-1892-4ca6-9ddf-efeeb9ce7185 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:35.670192 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-55711060-1b43-4561-a340-8a3bb8aede3c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.220073 Jan 28 20:28:35.670760 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 194/407] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:35 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:35.673292 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3a745f1b-1892-4ca6-9ddf-efeeb9ce7185 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.210901 Jan 28 20:28:35.673945 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 214/408] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:35 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:35.993447 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-aac58877-11a2-4712-a7f2-62ffed287bd4 req-aa4d6f2f-b334-4458-a9e8-d9c38e0c3592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb895887-c105-49c8-8ebb-6f2d7327a46c", "name": "network-vif-plugged", "status": "completed", "tag": "e0e35fd9-2a9a-446e-bf87-14668877b787"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:28:35.995106 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:28:35.995106 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:28:36.002951 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-aac58877-11a2-4712-a7f2-62ffed287bd4 req-aa4d6f2f-b334-4458-a9e8-d9c38e0c3592 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:36.003399 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-aac58877-11a2-4712-a7f2-62ffed287bd4 req-aa4d6f2f-b334-4458-a9e8-d9c38e0c3592 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:36.015077 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-aac58877-11a2-4712-a7f2-62ffed287bd4 req-aa4d6f2f-b334-4458-a9e8-d9c38e0c3592 service nova] Creating event network-vif-plugged:e0e35fd9-2a9a-446e-bf87-14668877b787 for instance cb895887-c105-49c8-8ebb-6f2d7327a46c on hv-cinder-82635 Jan 28 20:28:36.019952 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-aac58877-11a2-4712-a7f2-62ffed287bd4 req-aa4d6f2f-b334-4458-a9e8-d9c38e0c3592 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034212 Jan 28 20:28:36.020534 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 195/409] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:28:36.686884 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d9a00d5e-3b88-4c08-838a-165441adff2a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:36.687507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d9a00d5e-3b88-4c08-838a-165441adff2a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:36.690382 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-45ebb336-82b8-42f4-ad2b-c0211afadf22 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:36.691084 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-45ebb336-82b8-42f4-ad2b-c0211afadf22 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:36.693678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9a00d5e-3b88-4c08-838a-165441adff2a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:36.694149 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9a00d5e-3b88-4c08-838a-165441adff2a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:36.694949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9a00d5e-3b88-4c08-838a-165441adff2a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:36.695372 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9a00d5e-3b88-4c08-838a-165441adff2a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:36.697265 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-45ebb336-82b8-42f4-ad2b-c0211afadf22 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:36.697712 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-45ebb336-82b8-42f4-ad2b-c0211afadf22 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:36.698535 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-45ebb336-82b8-42f4-ad2b-c0211afadf22 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:36.698964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-45ebb336-82b8-42f4-ad2b-c0211afadf22 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:36.895156 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d9a00d5e-3b88-4c08-838a-165441adff2a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:36.897766 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-45ebb336-82b8-42f4-ad2b-c0211afadf22 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:36.904034 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d9a00d5e-3b88-4c08-838a-165441adff2a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.219994 Jan 28 20:28:36.904699 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 215/410] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:36 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:36.906281 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-45ebb336-82b8-42f4-ad2b-c0211afadf22 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.219786 Jan 28 20:28:36.906838 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 196/411] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:36 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:37.920204 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8fbcfac4-81e0-42e7-8df1-7f35dc8bff46 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:37.920810 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8fbcfac4-81e0-42e7-8df1-7f35dc8bff46 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:37.921412 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2ebde428-000d-46ae-a50f-f81b59518d35 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:37.922499 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2ebde428-000d-46ae-a50f-f81b59518d35 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:37.927227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8fbcfac4-81e0-42e7-8df1-7f35dc8bff46 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:37.927678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8fbcfac4-81e0-42e7-8df1-7f35dc8bff46 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:37.928133 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ebde428-000d-46ae-a50f-f81b59518d35 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:37.928465 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8fbcfac4-81e0-42e7-8df1-7f35dc8bff46 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:37.928563 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ebde428-000d-46ae-a50f-f81b59518d35 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:37.928902 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8fbcfac4-81e0-42e7-8df1-7f35dc8bff46 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:37.929317 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ebde428-000d-46ae-a50f-f81b59518d35 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:37.929736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ebde428-000d-46ae-a50f-f81b59518d35 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:38.130879 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2ebde428-000d-46ae-a50f-f81b59518d35 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:38.133731 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8fbcfac4-81e0-42e7-8df1-7f35dc8bff46 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:38.138216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2ebde428-000d-46ae-a50f-f81b59518d35 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.220352 Jan 28 20:28:38.139041 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 197/412] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:37 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:38.141089 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8fbcfac4-81e0-42e7-8df1-7f35dc8bff46 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.224513 Jan 28 20:28:38.141657 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 216/413] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:37 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:39.155703 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-fe4e07a1-4292-4638-aa9a-15e5612ebb25 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:39.156305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-fe4e07a1-4292-4638-aa9a-15e5612ebb25 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:39.157573 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0ab0f399-33ea-49f4-a199-34c1a20befe1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:39.158212 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0ab0f399-33ea-49f4-a199-34c1a20befe1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:39.162196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fe4e07a1-4292-4638-aa9a-15e5612ebb25 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:39.162638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fe4e07a1-4292-4638-aa9a-15e5612ebb25 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:39.163431 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fe4e07a1-4292-4638-aa9a-15e5612ebb25 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:39.163857 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fe4e07a1-4292-4638-aa9a-15e5612ebb25 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:39.164381 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ab0f399-33ea-49f4-a199-34c1a20befe1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:39.164830 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ab0f399-33ea-49f4-a199-34c1a20befe1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:39.165606 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ab0f399-33ea-49f4-a199-34c1a20befe1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:39.166069 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ab0f399-33ea-49f4-a199-34c1a20befe1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:39.357793 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fe4e07a1-4292-4638-aa9a-15e5612ebb25 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:39.361682 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0ab0f399-33ea-49f4-a199-34c1a20befe1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:39.365985 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-fe4e07a1-4292-4638-aa9a-15e5612ebb25 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.214014 Jan 28 20:28:39.366632 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 198/414] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:39 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:39.369593 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0ab0f399-33ea-49f4-a199-34c1a20befe1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.215880 Jan 28 20:28:39.370339 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 217/415] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:39 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:40.383434 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e00b4d3d-7a88-44da-8d86-14c9d212fea1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:40.384128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e00b4d3d-7a88-44da-8d86-14c9d212fea1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:40.387093 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-08e2fda9-7f8f-47c9-987f-8c6566c790ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:40.388395 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-08e2fda9-7f8f-47c9-987f-8c6566c790ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:40.390889 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e00b4d3d-7a88-44da-8d86-14c9d212fea1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:40.391407 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e00b4d3d-7a88-44da-8d86-14c9d212fea1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:40.392263 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e00b4d3d-7a88-44da-8d86-14c9d212fea1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:40.392875 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e00b4d3d-7a88-44da-8d86-14c9d212fea1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:40.398588 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08e2fda9-7f8f-47c9-987f-8c6566c790ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:40.399342 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08e2fda9-7f8f-47c9-987f-8c6566c790ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:40.400808 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08e2fda9-7f8f-47c9-987f-8c6566c790ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:40.403089 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08e2fda9-7f8f-47c9-987f-8c6566c790ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:40.637829 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e00b4d3d-7a88-44da-8d86-14c9d212fea1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:40.644341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-08e2fda9-7f8f-47c9-987f-8c6566c790ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:40.646520 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e00b4d3d-7a88-44da-8d86-14c9d212fea1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.268458 Jan 28 20:28:40.647090 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 199/416] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:40 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:40.655241 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-08e2fda9-7f8f-47c9-987f-8c6566c790ee tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.272646 Jan 28 20:28:40.658234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 218/417] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:40 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:41.663728 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-55d23dd5-79e8-439e-b344-3794ae7e1ea8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:41.664337 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-55d23dd5-79e8-439e-b344-3794ae7e1ea8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:41.670249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-55d23dd5-79e8-439e-b344-3794ae7e1ea8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:41.670700 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-55d23dd5-79e8-439e-b344-3794ae7e1ea8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:41.671483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-55d23dd5-79e8-439e-b344-3794ae7e1ea8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:41.671580 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-20e452d9-109b-4190-a647-73086c1fb43c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:41.671980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-55d23dd5-79e8-439e-b344-3794ae7e1ea8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:41.672076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-20e452d9-109b-4190-a647-73086c1fb43c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:41.677678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-20e452d9-109b-4190-a647-73086c1fb43c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:41.678141 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-20e452d9-109b-4190-a647-73086c1fb43c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:41.678904 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-20e452d9-109b-4190-a647-73086c1fb43c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:41.679326 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-20e452d9-109b-4190-a647-73086c1fb43c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:41.873713 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-55d23dd5-79e8-439e-b344-3794ae7e1ea8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:41.878202 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-20e452d9-109b-4190-a647-73086c1fb43c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:41.881661 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-55d23dd5-79e8-439e-b344-3794ae7e1ea8 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1318 microversion: 2.1 time: 0.221596 Jan 28 20:28:41.891263 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 200/418] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:41 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:41.891755 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-20e452d9-109b-4190-a647-73086c1fb43c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.221652 Jan 28 20:28:41.892701 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 219/419] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:41 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:42.898438 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dabda212-d178-4f74-b3a9-fac6b3b50e90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:42.899080 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dabda212-d178-4f74-b3a9-fac6b3b50e90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:42.905446 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dabda212-d178-4f74-b3a9-fac6b3b50e90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:42.905906 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dabda212-d178-4f74-b3a9-fac6b3b50e90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:42.906684 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dabda212-d178-4f74-b3a9-fac6b3b50e90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:42.907113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dabda212-d178-4f74-b3a9-fac6b3b50e90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:42.908424 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-6b83e45a-d403-4541-bb96-7124c6f6b12f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:42.909025 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-6b83e45a-d403-4541-bb96-7124c6f6b12f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:42.915394 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6b83e45a-d403-4541-bb96-7124c6f6b12f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:42.915831 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6b83e45a-d403-4541-bb96-7124c6f6b12f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:42.916608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6b83e45a-d403-4541-bb96-7124c6f6b12f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:42.917038 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6b83e45a-d403-4541-bb96-7124c6f6b12f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:43.118335 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-6b83e45a-d403-4541-bb96-7124c6f6b12f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:43.122179 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dabda212-d178-4f74-b3a9-fac6b3b50e90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:43.126777 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-6b83e45a-d403-4541-bb96-7124c6f6b12f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.221988 Jan 28 20:28:43.127448 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 220/420] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:42 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:43.130165 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dabda212-d178-4f74-b3a9-fac6b3b50e90 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1508 microversion: 2.1 time: 0.235283 Jan 28 20:28:43.130733 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 201/421] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:42 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:44.157178 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4dd32ec4-bc03-4178-be78-2f0ccfdac64e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:44.157978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4dd32ec4-bc03-4178-be78-2f0ccfdac64e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:44.165252 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4dd32ec4-bc03-4178-be78-2f0ccfdac64e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:44.166307 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4dd32ec4-bc03-4178-be78-2f0ccfdac64e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:44.167310 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4dd32ec4-bc03-4178-be78-2f0ccfdac64e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:44.167741 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4dd32ec4-bc03-4178-be78-2f0ccfdac64e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:44.308178 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4dd32ec4-bc03-4178-be78-2f0ccfdac64e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:44.314581 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4dd32ec4-bc03-4178-be78-2f0ccfdac64e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.166038 Jan 28 20:28:44.321820 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 221/422] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:44 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:45.332890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f6a84793-7a31-4788-9e43-3eb3bbcdeeea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:45.333593 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f6a84793-7a31-4788-9e43-3eb3bbcdeeea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:45.345101 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f6a84793-7a31-4788-9e43-3eb3bbcdeeea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:45.345557 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f6a84793-7a31-4788-9e43-3eb3bbcdeeea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:45.346385 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f6a84793-7a31-4788-9e43-3eb3bbcdeeea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:45.346820 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f6a84793-7a31-4788-9e43-3eb3bbcdeeea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:45.502035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f6a84793-7a31-4788-9e43-3eb3bbcdeeea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:45.502035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f6a84793-7a31-4788-9e43-3eb3bbcdeeea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.172646 Jan 28 20:28:45.502035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 202/423] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:45 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:45.508207 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-476464b2-e4ce-4e1f-8bc0-ede1623cc05f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db8b3c80-4bef-42ee-aa90-1018446dd9ce"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:28:45.510434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-476464b2-e4ce-4e1f-8bc0-ede1623cc05f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:45.517518 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-476464b2-e4ce-4e1f-8bc0-ede1623cc05f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:45.518206 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-476464b2-e4ce-4e1f-8bc0-ede1623cc05f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:45.519276 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-476464b2-e4ce-4e1f-8bc0-ede1623cc05f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:45.519768 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-476464b2-e4ce-4e1f-8bc0-ede1623cc05f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:45.827714 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-476464b2-e4ce-4e1f-8bc0-ede1623cc05f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "POST /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323239 Jan 28 20:28:45.828319 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 222/424] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:28:45 2022] POST /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:28:46.520441 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b9de365e-9cef-4b7d-8092-4fa9239947f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:46.521515 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b9de365e-9cef-4b7d-8092-4fa9239947f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:46.528305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b9de365e-9cef-4b7d-8092-4fa9239947f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:46.529045 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b9de365e-9cef-4b7d-8092-4fa9239947f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:46.529858 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b9de365e-9cef-4b7d-8092-4fa9239947f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:46.530324 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b9de365e-9cef-4b7d-8092-4fa9239947f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:46.668255 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b9de365e-9cef-4b7d-8092-4fa9239947f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:46.676797 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b9de365e-9cef-4b7d-8092-4fa9239947f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1500 microversion: 2.1 time: 0.160292 Jan 28 20:28:46.688638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 203/425] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:46 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:46.694607 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b1a922fc-4bec-4e1b-8e81-26eac0415727 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58fc3470-82e7-4bba-bd0f-4c345ebd9734"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:28:46.695781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b1a922fc-4bec-4e1b-8e81-26eac0415727 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:46.703822 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1a922fc-4bec-4e1b-8e81-26eac0415727 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:46.704501 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1a922fc-4bec-4e1b-8e81-26eac0415727 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:46.705345 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1a922fc-4bec-4e1b-8e81-26eac0415727 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:46.705863 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1a922fc-4bec-4e1b-8e81-26eac0415727 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:46.730930 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-b1a922fc-4bec-4e1b-8e81-26eac0415727 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] HTTP exception thrown: Cannot 'attach_volume' instance 0d03f1de-078d-4fff-aec4-7c91aaaa1eed while it is in vm_state rescued Jan 28 20:28:46.731517 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b1a922fc-4bec-4e1b-8e81-26eac0415727 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Returning 409 to user: Cannot 'attach_volume' instance 0d03f1de-078d-4fff-aec4-7c91aaaa1eed while it is in vm_state rescued {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:28:46.732337 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b1a922fc-4bec-4e1b-8e81-26eac0415727 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042410 Jan 28 20:28:46.732939 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 223/426] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:28:46 2022] POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 20:28:46.741128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0c1a8f8a-f188-4526-8e9f-548275084fd1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:28:46.741661 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0c1a8f8a-f188-4526-8e9f-548275084fd1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:46.748648 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0c1a8f8a-f188-4526-8e9f-548275084fd1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:46.749574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0c1a8f8a-f188-4526-8e9f-548275084fd1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:46.750430 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0c1a8f8a-f188-4526-8e9f-548275084fd1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:46.750868 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0c1a8f8a-f188-4526-8e9f-548275084fd1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:46.834172 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0c1a8f8a-f188-4526-8e9f-548275084fd1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/action" status: 202 len: 0 microversion: 2.1 time: 0.096177 Jan 28 20:28:46.834813 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 204/427] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:28:46 2022] POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:28:46.843750 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4548d26e-a0fe-4834-8be4-f4f45c28067b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:46.845136 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4548d26e-a0fe-4834-8be4-f4f45c28067b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:46.862137 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4548d26e-a0fe-4834-8be4-f4f45c28067b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:46.862955 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4548d26e-a0fe-4834-8be4-f4f45c28067b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:46.863824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4548d26e-a0fe-4834-8be4-f4f45c28067b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:46.870394 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4548d26e-a0fe-4834-8be4-f4f45c28067b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:47.101256 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4548d26e-a0fe-4834-8be4-f4f45c28067b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:47.109723 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4548d26e-a0fe-4834-8be4-f4f45c28067b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1508 microversion: 2.1 time: 0.270520 Jan 28 20:28:47.110952 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 224/428] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:46 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:48.127582 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5cadeb17-49da-4ca9-9ff7-ab1974ce8ae5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:48.128278 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5cadeb17-49da-4ca9-9ff7-ab1974ce8ae5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:48.134910 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5cadeb17-49da-4ca9-9ff7-ab1974ce8ae5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:48.135359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5cadeb17-49da-4ca9-9ff7-ab1974ce8ae5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:48.136152 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5cadeb17-49da-4ca9-9ff7-ab1974ce8ae5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:48.136587 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5cadeb17-49da-4ca9-9ff7-ab1974ce8ae5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:48.277462 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5cadeb17-49da-4ca9-9ff7-ab1974ce8ae5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:48.285113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5cadeb17-49da-4ca9-9ff7-ab1974ce8ae5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1508 microversion: 2.1 time: 0.161495 Jan 28 20:28:48.285681 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 205/429] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:48 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:49.303212 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1203b298-72b1-47dc-8378-e21aebc1c6a0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:49.303844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1203b298-72b1-47dc-8378-e21aebc1c6a0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:49.311029 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1203b298-72b1-47dc-8378-e21aebc1c6a0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:49.311476 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1203b298-72b1-47dc-8378-e21aebc1c6a0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:49.312247 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1203b298-72b1-47dc-8378-e21aebc1c6a0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:49.312673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1203b298-72b1-47dc-8378-e21aebc1c6a0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:49.452394 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1203b298-72b1-47dc-8378-e21aebc1c6a0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:49.459505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1203b298-72b1-47dc-8378-e21aebc1c6a0 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1508 microversion: 2.1 time: 0.159904 Jan 28 20:28:49.460059 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 225/430] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:49 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:50.474973 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-017ca872-caf9-4d02-a377-e410b169e42c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:50.475570 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-017ca872-caf9-4d02-a377-e410b169e42c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:50.481360 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-017ca872-caf9-4d02-a377-e410b169e42c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:50.481799 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-017ca872-caf9-4d02-a377-e410b169e42c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:50.482593 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-017ca872-caf9-4d02-a377-e410b169e42c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:50.483026 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-017ca872-caf9-4d02-a377-e410b169e42c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:50.613408 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-017ca872-caf9-4d02-a377-e410b169e42c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:50.620612 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-017ca872-caf9-4d02-a377-e410b169e42c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1508 microversion: 2.1 time: 0.149184 Jan 28 20:28:50.621178 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 206/431] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:50 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:51.637511 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-48417f60-8dcd-4e94-b4fd-db3a8559c018 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:51.638137 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-48417f60-8dcd-4e94-b4fd-db3a8559c018 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:51.644497 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-48417f60-8dcd-4e94-b4fd-db3a8559c018 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:51.644937 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-48417f60-8dcd-4e94-b4fd-db3a8559c018 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:51.645704 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-48417f60-8dcd-4e94-b4fd-db3a8559c018 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:51.646160 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-48417f60-8dcd-4e94-b4fd-db3a8559c018 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:51.773430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-48417f60-8dcd-4e94-b4fd-db3a8559c018 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:51.781506 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-48417f60-8dcd-4e94-b4fd-db3a8559c018 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1508 microversion: 2.1 time: 0.148224 Jan 28 20:28:51.782092 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 226/432] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:51 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:52.798450 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-57cc2739-37a8-4452-8674-3b00ef851ad6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:52.798985 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-57cc2739-37a8-4452-8674-3b00ef851ad6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:52.804730 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57cc2739-37a8-4452-8674-3b00ef851ad6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:52.805173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57cc2739-37a8-4452-8674-3b00ef851ad6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:52.805971 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57cc2739-37a8-4452-8674-3b00ef851ad6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:52.806407 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57cc2739-37a8-4452-8674-3b00ef851ad6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:52.940027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-57cc2739-37a8-4452-8674-3b00ef851ad6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:52.947296 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-57cc2739-37a8-4452-8674-3b00ef851ad6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1508 microversion: 2.1 time: 0.152613 Jan 28 20:28:52.947861 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 207/433] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:52 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:53.964788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e79164ad-1564-43db-9c3f-6cc14eddd70a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:53.965459 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e79164ad-1564-43db-9c3f-6cc14eddd70a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:53.971734 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e79164ad-1564-43db-9c3f-6cc14eddd70a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:53.972178 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e79164ad-1564-43db-9c3f-6cc14eddd70a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:53.972954 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e79164ad-1564-43db-9c3f-6cc14eddd70a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:53.973384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e79164ad-1564-43db-9c3f-6cc14eddd70a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:54.115617 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e79164ad-1564-43db-9c3f-6cc14eddd70a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:54.122844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e79164ad-1564-43db-9c3f-6cc14eddd70a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1508 microversion: 2.1 time: 0.162219 Jan 28 20:28:54.123409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 227/434] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:53 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:55.139260 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-33eca161-cbeb-4324-9936-19e487163bda tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:55.139909 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-33eca161-cbeb-4324-9936-19e487163bda tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:55.145750 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-33eca161-cbeb-4324-9936-19e487163bda tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:55.146229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-33eca161-cbeb-4324-9936-19e487163bda tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:55.147000 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-33eca161-cbeb-4324-9936-19e487163bda tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:55.147429 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-33eca161-cbeb-4324-9936-19e487163bda tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:55.278801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-33eca161-cbeb-4324-9936-19e487163bda tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:55.286566 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-33eca161-cbeb-4324-9936-19e487163bda tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1508 microversion: 2.1 time: 0.150824 Jan 28 20:28:55.287136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 208/435] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:55 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:28:56.304076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-61dc4b28-3091-4919-b3fe-1b76dab7dd2c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:28:56.304674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-61dc4b28-3091-4919-b3fe-1b76dab7dd2c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:56.311635 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61dc4b28-3091-4919-b3fe-1b76dab7dd2c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:56.312136 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61dc4b28-3091-4919-b3fe-1b76dab7dd2c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:56.312872 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61dc4b28-3091-4919-b3fe-1b76dab7dd2c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:56.313293 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61dc4b28-3091-4919-b3fe-1b76dab7dd2c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:56.463002 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-61dc4b28-3091-4919-b3fe-1b76dab7dd2c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:28:56.470496 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-61dc4b28-3091-4919-b3fe-1b76dab7dd2c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1514 microversion: 2.1 time: 0.169971 Jan 28 20:28:56.471052 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 228/436] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:28:56 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:28:58.234706 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0832e4c4-5d2a-4903-ba38-512d9b8c1ca0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83f327e4-a848-4c76-85ea-aba6360cda5c", "device": "/dev/sdb"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:28:58.236339 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0832e4c4-5d2a-4903-ba38-512d9b8c1ca0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:28:58.242228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0832e4c4-5d2a-4903-ba38-512d9b8c1ca0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:58.242681 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0832e4c4-5d2a-4903-ba38-512d9b8c1ca0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:58.243451 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0832e4c4-5d2a-4903-ba38-512d9b8c1ca0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:28:58.243880 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0832e4c4-5d2a-4903-ba38-512d9b8c1ca0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:28:58.514244 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0832e4c4-5d2a-4903-ba38-512d9b8c1ca0 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "POST /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283000 Jan 28 20:28:58.514938 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 209/437] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:28:58 2022] POST /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:13.471472 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3ccc5387-3e80-4963-bdec-d29d7b7fd4d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:13.472071 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3ccc5387-3e80-4963-bdec-d29d7b7fd4d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:13.478305 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ccc5387-3e80-4963-bdec-d29d7b7fd4d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:13.478746 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ccc5387-3e80-4963-bdec-d29d7b7fd4d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:13.480299 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ccc5387-3e80-4963-bdec-d29d7b7fd4d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:13.480756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ccc5387-3e80-4963-bdec-d29d7b7fd4d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:13.613684 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3ccc5387-3e80-4963-bdec-d29d7b7fd4d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:13.622588 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3ccc5387-3e80-4963-bdec-d29d7b7fd4d3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1514 microversion: 2.1 time: 0.154550 Jan 28 20:29:13.623268 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 229/438] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:13 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:13.641174 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-50eec2bb-60d7-4adb-a2fd-5e3351730560 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a18c9ce5-6038-4ab1-bcff-959b959dd1b5"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:29:13.642524 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-50eec2bb-60d7-4adb-a2fd-5e3351730560 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:13.649501 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50eec2bb-60d7-4adb-a2fd-5e3351730560 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:13.650069 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50eec2bb-60d7-4adb-a2fd-5e3351730560 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:13.650938 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50eec2bb-60d7-4adb-a2fd-5e3351730560 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:13.651568 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50eec2bb-60d7-4adb-a2fd-5e3351730560 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:13.896248 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-50eec2bb-60d7-4adb-a2fd-5e3351730560 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260575 Jan 28 20:29:13.896854 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 210/439] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:29:13 2022] POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:24.879732 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d235b2d1-08d9-4008-b915-72676dd8f973 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db8b3c80-4bef-42ee-aa90-1018446dd9ce"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:29:24.880897 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d235b2d1-08d9-4008-b915-72676dd8f973 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:24.887984 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d235b2d1-08d9-4008-b915-72676dd8f973 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:24.888335 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d235b2d1-08d9-4008-b915-72676dd8f973 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:24.889117 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d235b2d1-08d9-4008-b915-72676dd8f973 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:24.889556 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d235b2d1-08d9-4008-b915-72676dd8f973 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:24.963863 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-d235b2d1-08d9-4008-b915-72676dd8f973 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] HTTP exception thrown: Invalid volume: volume db8b3c80-4bef-42ee-aa90-1018446dd9ce is already attached to instances: cb895887-c105-49c8-8ebb-6f2d7327a46c Jan 28 20:29:24.964448 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d235b2d1-08d9-4008-b915-72676dd8f973 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Returning 400 to user: Invalid volume: volume db8b3c80-4bef-42ee-aa90-1018446dd9ce is already attached to instances: cb895887-c105-49c8-8ebb-6f2d7327a46c {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:29:24.965298 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d235b2d1-08d9-4008-b915-72676dd8f973 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "POST /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089680 Jan 28 20:29:24.965841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 230/440] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:29:24 2022] POST /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 20:29:25.024302 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5feba6a2-7768-445d-8f2e-d4807d3d083d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:25.024948 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5feba6a2-7768-445d-8f2e-d4807d3d083d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:25.035720 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5feba6a2-7768-445d-8f2e-d4807d3d083d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:25.036161 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5feba6a2-7768-445d-8f2e-d4807d3d083d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:25.036942 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5feba6a2-7768-445d-8f2e-d4807d3d083d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:25.037377 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5feba6a2-7768-445d-8f2e-d4807d3d083d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:25.113549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-5feba6a2-7768-445d-8f2e-d4807d3d083d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lazy-loading 'services' on Instance uuid cb895887-c105-49c8-8ebb-6f2d7327a46c {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:29:25.184376 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5feba6a2-7768-445d-8f2e-d4807d3d083d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments/db8b3c80-4bef-42ee-aa90-1018446dd9ce" status: 202 len: 0 microversion: 2.1 time: 0.164544 Jan 28 20:29:25.185043 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 211/441] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:29:25 2022] DELETE /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments/db8b3c80-4bef-42ee-aa90-1018446dd9ce => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:29:25.193093 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3ce7b24b-aea6-4ebc-90ac-4826668033ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:25.194014 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3ce7b24b-aea6-4ebc-90ac-4826668033ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:25.199733 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ce7b24b-aea6-4ebc-90ac-4826668033ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:25.200232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ce7b24b-aea6-4ebc-90ac-4826668033ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:25.201261 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ce7b24b-aea6-4ebc-90ac-4826668033ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:25.201734 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ce7b24b-aea6-4ebc-90ac-4826668033ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:25.231440 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3ce7b24b-aea6-4ebc-90ac-4826668033ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042109 Jan 28 20:29:25.231990 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 231/442] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:25 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:26.243785 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ec0715c0-2f1b-435b-b393-98e7f6fc34bd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:26.244892 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ec0715c0-2f1b-435b-b393-98e7f6fc34bd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:26.250947 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ec0715c0-2f1b-435b-b393-98e7f6fc34bd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:26.251394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ec0715c0-2f1b-435b-b393-98e7f6fc34bd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:26.252168 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ec0715c0-2f1b-435b-b393-98e7f6fc34bd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:26.252597 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ec0715c0-2f1b-435b-b393-98e7f6fc34bd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:26.283592 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ec0715c0-2f1b-435b-b393-98e7f6fc34bd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Jan 28 20:29:26.284108 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 212/443] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:26 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:27.295351 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-714e37dc-cd78-441b-bad0-d6bbfe5abaac tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:27.296259 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-714e37dc-cd78-441b-bad0-d6bbfe5abaac tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:27.302444 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-714e37dc-cd78-441b-bad0-d6bbfe5abaac tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:27.302885 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-714e37dc-cd78-441b-bad0-d6bbfe5abaac tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:27.303677 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-714e37dc-cd78-441b-bad0-d6bbfe5abaac tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:27.304103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-714e37dc-cd78-441b-bad0-d6bbfe5abaac tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:27.332871 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-714e37dc-cd78-441b-bad0-d6bbfe5abaac tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041898 Jan 28 20:29:27.333422 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 232/444] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:27 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:28.344501 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3854004e-d7f9-41fc-a930-36abd24830ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:28.345415 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3854004e-d7f9-41fc-a930-36abd24830ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:28.351136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3854004e-d7f9-41fc-a930-36abd24830ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:28.351586 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3854004e-d7f9-41fc-a930-36abd24830ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:28.352360 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3854004e-d7f9-41fc-a930-36abd24830ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:28.352803 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3854004e-d7f9-41fc-a930-36abd24830ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:28.381562 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3854004e-d7f9-41fc-a930-36abd24830ca tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040856 Jan 28 20:29:28.382143 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 213/445] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:28 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:29.392893 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-be353801-0b21-4209-a7cc-0cb367ffff72 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:29.393909 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-be353801-0b21-4209-a7cc-0cb367ffff72 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:29.400001 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-be353801-0b21-4209-a7cc-0cb367ffff72 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:29.400426 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-be353801-0b21-4209-a7cc-0cb367ffff72 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:29.401334 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-be353801-0b21-4209-a7cc-0cb367ffff72 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:29.401754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-be353801-0b21-4209-a7cc-0cb367ffff72 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:29.431571 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-be353801-0b21-4209-a7cc-0cb367ffff72 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042354 Jan 28 20:29:29.432845 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 233/446] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:29 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:30.443389 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-89309f99-9d2c-4e93-b5c8-fe107c91f00d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:30.444287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-89309f99-9d2c-4e93-b5c8-fe107c91f00d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:30.451040 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-89309f99-9d2c-4e93-b5c8-fe107c91f00d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:30.451485 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-89309f99-9d2c-4e93-b5c8-fe107c91f00d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:30.452253 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-89309f99-9d2c-4e93-b5c8-fe107c91f00d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:30.452677 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-89309f99-9d2c-4e93-b5c8-fe107c91f00d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:30.484125 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-89309f99-9d2c-4e93-b5c8-fe107c91f00d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Jan 28 20:29:30.484581 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 214/447] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:30 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:31.495846 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-918777da-8a5f-4c9a-99ae-c1432bd24c21 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:31.496851 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-918777da-8a5f-4c9a-99ae-c1432bd24c21 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:31.503982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-918777da-8a5f-4c9a-99ae-c1432bd24c21 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:31.504539 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-918777da-8a5f-4c9a-99ae-c1432bd24c21 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:31.505612 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-918777da-8a5f-4c9a-99ae-c1432bd24c21 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:31.506075 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-918777da-8a5f-4c9a-99ae-c1432bd24c21 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:31.538271 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-918777da-8a5f-4c9a-99ae-c1432bd24c21 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046506 Jan 28 20:29:31.538619 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 234/448] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:31 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:32.138987 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1760852880", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1067414585", "security_groups": [{"name": "tempest-secgroup-smoke-35562867"}], "block_device_mapping_v2": [{"uuid": "2ccdf64f-e6e2-4857-8f93-a5593e93ea89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4706b4ac-208e-49dd-94bd-78970bce488d"}]}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:29:32.381780 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] validate_networks() for [('4706b4ac-208e-49dd-94bd-78970bce488d', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:29:32.550932 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-815e1c48-2985-4760-99ef-418b8d8c24bc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:32.552579 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-815e1c48-2985-4760-99ef-418b8d8c24bc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:32.559899 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-815e1c48-2985-4760-99ef-418b8d8c24bc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:32.560544 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-815e1c48-2985-4760-99ef-418b8d8c24bc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:32.561830 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-815e1c48-2985-4760-99ef-418b8d8c24bc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:32.562474 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-815e1c48-2985-4760-99ef-418b8d8c24bc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:32.619676 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-815e1c48-2985-4760-99ef-418b8d8c24bc tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073072 Jan 28 20:29:32.620260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 235/449] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:32 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:29:32.826883 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:29:32.827451 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:29:32.828095 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:29:32.828636 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:29:32.829108 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:29:32.843497 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:32.844030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:32.844947 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:32.845382 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:32.862181 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:29:32.866072 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for user daa1f16966e94f0fb861bf124bbc0aac and project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:29:32.919975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:29:32.922118 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ccdf64f-e6e2-4857-8f93-a5593e93ea89',volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:29:33.056398 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c807aed4-ebfc-45bb-9e2b-69ee2f013002 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.923549 Jan 28 20:29:33.057584 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 215/450] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:29:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:29:33.068261 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-64ddef5b-af7f-414c-930d-1430d23c79f1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:33.068876 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-64ddef5b-af7f-414c-930d-1430d23c79f1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:33.128585 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-64ddef5b-af7f-414c-930d-1430d23c79f1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:33.135527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-64ddef5b-af7f-414c-930d-1430d23c79f1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1095 microversion: 2.1 time: 0.071562 Jan 28 20:29:33.136089 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 236/451] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:33 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:33.631574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0515e2a7-0978-47d9-bfa1-a3c3d8f2f1c4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:33.632493 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0515e2a7-0978-47d9-bfa1-a3c3d8f2f1c4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:33.640843 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0515e2a7-0978-47d9-bfa1-a3c3d8f2f1c4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:33.641282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0515e2a7-0978-47d9-bfa1-a3c3d8f2f1c4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:33.642106 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0515e2a7-0978-47d9-bfa1-a3c3d8f2f1c4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:33.642542 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0515e2a7-0978-47d9-bfa1-a3c3d8f2f1c4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:33.671647 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0515e2a7-0978-47d9-bfa1-a3c3d8f2f1c4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Jan 28 20:29:33.672206 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 216/452] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:33 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:34.152051 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7e0c6a09-86a0-481e-8dc6-3ad7bf22da5b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:34.153057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7e0c6a09-86a0-481e-8dc6-3ad7bf22da5b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:34.159574 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e0c6a09-86a0-481e-8dc6-3ad7bf22da5b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:34.160165 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e0c6a09-86a0-481e-8dc6-3ad7bf22da5b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:34.161055 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e0c6a09-86a0-481e-8dc6-3ad7bf22da5b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:34.161555 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e0c6a09-86a0-481e-8dc6-3ad7bf22da5b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:34.222744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7e0c6a09-86a0-481e-8dc6-3ad7bf22da5b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:34.231148 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7e0c6a09-86a0-481e-8dc6-3ad7bf22da5b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1211 microversion: 2.1 time: 0.082731 Jan 28 20:29:34.231701 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 237/453] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:34 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:34.685180 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-65460f4a-7b73-47e2-93f3-1a9d5d83abc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:34.686154 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-65460f4a-7b73-47e2-93f3-1a9d5d83abc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:34.692515 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-65460f4a-7b73-47e2-93f3-1a9d5d83abc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:34.692957 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-65460f4a-7b73-47e2-93f3-1a9d5d83abc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:34.693734 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-65460f4a-7b73-47e2-93f3-1a9d5d83abc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:34.694375 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-65460f4a-7b73-47e2-93f3-1a9d5d83abc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:34.723446 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-65460f4a-7b73-47e2-93f3-1a9d5d83abc3 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042432 Jan 28 20:29:34.724024 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 217/454] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:34 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:29:35.247809 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ae329ddc-79aa-4b92-bfdc-b60e7e0bb233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:35.248347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ae329ddc-79aa-4b92-bfdc-b60e7e0bb233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:35.254604 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ae329ddc-79aa-4b92-bfdc-b60e7e0bb233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:35.255048 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ae329ddc-79aa-4b92-bfdc-b60e7e0bb233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:35.255807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ae329ddc-79aa-4b92-bfdc-b60e7e0bb233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:35.256231 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ae329ddc-79aa-4b92-bfdc-b60e7e0bb233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:35.315366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ae329ddc-79aa-4b92-bfdc-b60e7e0bb233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:35.322710 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ae329ddc-79aa-4b92-bfdc-b60e7e0bb233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1211 microversion: 2.1 time: 0.078716 Jan 28 20:29:35.323267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 238/455] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:35 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:35.734637 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4da611eb-6386-4ff0-af7f-adf37eecab78 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:35.735558 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4da611eb-6386-4ff0-af7f-adf37eecab78 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:35.741858 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4da611eb-6386-4ff0-af7f-adf37eecab78 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:35.742338 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4da611eb-6386-4ff0-af7f-adf37eecab78 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:35.743122 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4da611eb-6386-4ff0-af7f-adf37eecab78 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:35.743558 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4da611eb-6386-4ff0-af7f-adf37eecab78 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:35.772843 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4da611eb-6386-4ff0-af7f-adf37eecab78 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041763 Jan 28 20:29:35.773330 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 218/456] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:35 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:36.339060 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a389f029-0ef9-4801-a931-f4d8db4ca70f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:36.339691 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a389f029-0ef9-4801-a931-f4d8db4ca70f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:36.345881 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a389f029-0ef9-4801-a931-f4d8db4ca70f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:36.346344 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a389f029-0ef9-4801-a931-f4d8db4ca70f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:36.347103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a389f029-0ef9-4801-a931-f4d8db4ca70f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:36.347527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a389f029-0ef9-4801-a931-f4d8db4ca70f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:36.406217 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a389f029-0ef9-4801-a931-f4d8db4ca70f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:36.413210 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a389f029-0ef9-4801-a931-f4d8db4ca70f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1211 microversion: 2.1 time: 0.077735 Jan 28 20:29:36.413772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 239/457] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:36 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:36.784384 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cb0d667f-ec7a-4a00-9367-369b8bc35233 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:36.785348 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cb0d667f-ec7a-4a00-9367-369b8bc35233 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:36.791919 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb0d667f-ec7a-4a00-9367-369b8bc35233 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:36.792380 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb0d667f-ec7a-4a00-9367-369b8bc35233 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:36.793276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb0d667f-ec7a-4a00-9367-369b8bc35233 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:36.793743 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb0d667f-ec7a-4a00-9367-369b8bc35233 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:36.823474 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cb0d667f-ec7a-4a00-9367-369b8bc35233 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042056 Jan 28 20:29:36.824016 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 219/458] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:36 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:37.430312 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-835cfc6c-6c2a-49d0-a800-5c4237e70e09 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:37.430860 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-835cfc6c-6c2a-49d0-a800-5c4237e70e09 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:37.437816 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-835cfc6c-6c2a-49d0-a800-5c4237e70e09 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:37.438377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-835cfc6c-6c2a-49d0-a800-5c4237e70e09 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:37.439172 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-835cfc6c-6c2a-49d0-a800-5c4237e70e09 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:37.439602 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-835cfc6c-6c2a-49d0-a800-5c4237e70e09 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:37.502826 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-835cfc6c-6c2a-49d0-a800-5c4237e70e09 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:37.510621 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-835cfc6c-6c2a-49d0-a800-5c4237e70e09 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1211 microversion: 2.1 time: 0.084131 Jan 28 20:29:37.511383 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 240/459] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:37 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:37.836140 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-86a55f45-0491-4a2f-9431-d98eb8e60156 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:37.837165 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-86a55f45-0491-4a2f-9431-d98eb8e60156 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:37.847188 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86a55f45-0491-4a2f-9431-d98eb8e60156 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:37.847699 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86a55f45-0491-4a2f-9431-d98eb8e60156 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:37.848525 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86a55f45-0491-4a2f-9431-d98eb8e60156 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:37.848955 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-86a55f45-0491-4a2f-9431-d98eb8e60156 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:37.881733 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-86a55f45-0491-4a2f-9431-d98eb8e60156 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050870 Jan 28 20:29:37.882590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 220/460] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:37 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:38.527739 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-eab22a65-e08d-44d5-95c4-66c2801f8d36 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:38.528351 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-eab22a65-e08d-44d5-95c4-66c2801f8d36 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:38.534615 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eab22a65-e08d-44d5-95c4-66c2801f8d36 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:38.535057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eab22a65-e08d-44d5-95c4-66c2801f8d36 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:38.535830 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eab22a65-e08d-44d5-95c4-66c2801f8d36 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:38.536255 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eab22a65-e08d-44d5-95c4-66c2801f8d36 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:38.670866 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-eab22a65-e08d-44d5-95c4-66c2801f8d36 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:38.677969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-eab22a65-e08d-44d5-95c4-66c2801f8d36 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.154210 Jan 28 20:29:38.678523 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 241/461] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:38 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:38.893727 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f19727d9-51de-4fbc-b398-21387dbf3bf0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:38.894671 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f19727d9-51de-4fbc-b398-21387dbf3bf0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:38.902771 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f19727d9-51de-4fbc-b398-21387dbf3bf0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:38.903223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f19727d9-51de-4fbc-b398-21387dbf3bf0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:38.904023 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f19727d9-51de-4fbc-b398-21387dbf3bf0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:38.904454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f19727d9-51de-4fbc-b398-21387dbf3bf0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:38.934350 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f19727d9-51de-4fbc-b398-21387dbf3bf0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Jan 28 20:29:38.934916 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 221/462] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:38 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:39.427035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-6cec61de-aa9c-4637-9c9c-3f143d13d41c req-ed28f007-e9cc-45fc-aad7-baefe43a77c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3427e95-2a32-4161-ad46-076cf02f603d", "tag": "c5693d83-b5f3-413b-a2a5-d05a5cb7e05a"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:29:39.430122 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:29:39.430122 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:29:39.438569 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-6cec61de-aa9c-4637-9c9c-3f143d13d41c req-ed28f007-e9cc-45fc-aad7-baefe43a77c3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:39.439608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-6cec61de-aa9c-4637-9c9c-3f143d13d41c req-ed28f007-e9cc-45fc-aad7-baefe43a77c3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:39.467528 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-6cec61de-aa9c-4637-9c9c-3f143d13d41c req-ed28f007-e9cc-45fc-aad7-baefe43a77c3 service nova] Creating event network-changed:c5693d83-b5f3-413b-a2a5-d05a5cb7e05a for instance e3427e95-2a32-4161-ad46-076cf02f603d on hv-cinder-82635 Jan 28 20:29:39.473573 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-6cec61de-aa9c-4637-9c9c-3f143d13d41c req-ed28f007-e9cc-45fc-aad7-baefe43a77c3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052922 Jan 28 20:29:39.474748 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 242/463] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:39.695604 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6741416b-b8e8-4171-9df4-78254111b33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:39.696222 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6741416b-b8e8-4171-9df4-78254111b33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:39.704045 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6741416b-b8e8-4171-9df4-78254111b33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:39.705495 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6741416b-b8e8-4171-9df4-78254111b33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:39.706410 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6741416b-b8e8-4171-9df4-78254111b33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:39.706846 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6741416b-b8e8-4171-9df4-78254111b33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:39.844683 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6741416b-b8e8-4171-9df4-78254111b33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:39.852776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6741416b-b8e8-4171-9df4-78254111b33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.161351 Jan 28 20:29:39.853352 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 222/464] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:39 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:39.947002 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3ffd25be-6c02-44ae-83e8-389257020f80 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:39.948018 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3ffd25be-6c02-44ae-83e8-389257020f80 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:39.954535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ffd25be-6c02-44ae-83e8-389257020f80 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:39.955224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ffd25be-6c02-44ae-83e8-389257020f80 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:39.956007 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ffd25be-6c02-44ae-83e8-389257020f80 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:39.956534 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ffd25be-6c02-44ae-83e8-389257020f80 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:39.986715 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3ffd25be-6c02-44ae-83e8-389257020f80 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Jan 28 20:29:39.987509 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 243/465] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:39 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:40.868558 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-eec4eb78-72c4-4af0-987a-527f104ad0ed tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:40.869159 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-eec4eb78-72c4-4af0-987a-527f104ad0ed tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:40.875457 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-eec4eb78-72c4-4af0-987a-527f104ad0ed tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:40.875899 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-eec4eb78-72c4-4af0-987a-527f104ad0ed tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:40.876682 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-eec4eb78-72c4-4af0-987a-527f104ad0ed tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:40.877100 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-eec4eb78-72c4-4af0-987a-527f104ad0ed tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:40.998969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-69fc3b47-c8d8-4242-aff0-42cdc2556cc0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:41.000005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-69fc3b47-c8d8-4242-aff0-42cdc2556cc0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:41.005772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-69fc3b47-c8d8-4242-aff0-42cdc2556cc0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:41.006328 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-69fc3b47-c8d8-4242-aff0-42cdc2556cc0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:41.007169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-69fc3b47-c8d8-4242-aff0-42cdc2556cc0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:41.007663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-69fc3b47-c8d8-4242-aff0-42cdc2556cc0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:41.016896 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-eec4eb78-72c4-4af0-987a-527f104ad0ed tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:41.024068 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-eec4eb78-72c4-4af0-987a-527f104ad0ed tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.159092 Jan 28 20:29:41.024626 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 223/466] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:40 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:41.038878 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-69fc3b47-c8d8-4242-aff0-42cdc2556cc0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Jan 28 20:29:41.039441 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 244/467] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:40 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:29:41.364265 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d246c6e4-eca3-4016-bc6e-5c779da61976 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:29:41.365272 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d246c6e4-eca3-4016-bc6e-5c779da61976 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:41.371611 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d246c6e4-eca3-4016-bc6e-5c779da61976 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:41.372114 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d246c6e4-eca3-4016-bc6e-5c779da61976 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:41.372882 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d246c6e4-eca3-4016-bc6e-5c779da61976 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:41.373307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d246c6e4-eca3-4016-bc6e-5c779da61976 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:41.395993 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-d246c6e4-eca3-4016-bc6e-5c779da61976 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lazy-loading 'flavor' on Instance uuid 0d03f1de-078d-4fff-aec4-7c91aaaa1eed {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:29:41.547882 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d246c6e4-eca3-4016-bc6e-5c779da61976 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/action" status: 200 len: 32 microversion: 2.1 time: 0.187818 Jan 28 20:29:41.548408 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 224/468] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:29:41 2022] POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 20:29:41.558113 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ffb23a3a-11c8-4a6e-8b6c-f893b608b0bf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:41.558684 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ffb23a3a-11c8-4a6e-8b6c-f893b608b0bf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:41.564395 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ffb23a3a-11c8-4a6e-8b6c-f893b608b0bf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:41.564836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ffb23a3a-11c8-4a6e-8b6c-f893b608b0bf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:41.565594 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ffb23a3a-11c8-4a6e-8b6c-f893b608b0bf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:41.566050 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ffb23a3a-11c8-4a6e-8b6c-f893b608b0bf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:41.695858 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ffb23a3a-11c8-4a6e-8b6c-f893b608b0bf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:41.703589 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ffb23a3a-11c8-4a6e-8b6c-f893b608b0bf tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.149997 Jan 28 20:29:41.704145 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 245/469] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:41 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:29:42.041789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4db1edb5-46dd-40b1-8031-748f2f5d342c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:42.042503 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4db1edb5-46dd-40b1-8031-748f2f5d342c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:42.048676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4db1edb5-46dd-40b1-8031-748f2f5d342c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:42.049114 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4db1edb5-46dd-40b1-8031-748f2f5d342c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:42.049954 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4db1edb5-46dd-40b1-8031-748f2f5d342c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:42.050184 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-eda7f356-6a87-4d02-9c8f-d433f057dce1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:42.050566 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4db1edb5-46dd-40b1-8031-748f2f5d342c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:42.051094 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-eda7f356-6a87-4d02-9c8f-d433f057dce1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:42.057248 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eda7f356-6a87-4d02-9c8f-d433f057dce1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:42.057848 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eda7f356-6a87-4d02-9c8f-d433f057dce1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:42.058665 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eda7f356-6a87-4d02-9c8f-d433f057dce1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:42.059096 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eda7f356-6a87-4d02-9c8f-d433f057dce1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:42.087723 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-eda7f356-6a87-4d02-9c8f-d433f057dce1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041133 Jan 28 20:29:42.088783 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 246/470] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:42 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:29:42.181465 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4db1edb5-46dd-40b1-8031-748f2f5d342c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:42.188743 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4db1edb5-46dd-40b1-8031-748f2f5d342c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.151848 Jan 28 20:29:42.189301 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 225/471] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:42 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:42.719674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-73894cdd-882e-4700-b929-0af5fc5c0cd6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:42.720276 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-73894cdd-882e-4700-b929-0af5fc5c0cd6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:42.726486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-73894cdd-882e-4700-b929-0af5fc5c0cd6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:42.726934 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-73894cdd-882e-4700-b929-0af5fc5c0cd6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:42.727891 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-73894cdd-882e-4700-b929-0af5fc5c0cd6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:42.728322 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-73894cdd-882e-4700-b929-0af5fc5c0cd6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:42.874972 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-73894cdd-882e-4700-b929-0af5fc5c0cd6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:42.883203 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-73894cdd-882e-4700-b929-0af5fc5c0cd6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.167048 Jan 28 20:29:42.883787 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 247/472] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:42 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:43.099450 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-96546045-aa5f-439b-8d9a-08ce11ff489f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:43.100363 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-96546045-aa5f-439b-8d9a-08ce11ff489f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:43.107091 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-96546045-aa5f-439b-8d9a-08ce11ff489f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:43.107538 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-96546045-aa5f-439b-8d9a-08ce11ff489f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:43.108309 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-96546045-aa5f-439b-8d9a-08ce11ff489f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:43.108756 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-96546045-aa5f-439b-8d9a-08ce11ff489f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:43.137124 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-96546045-aa5f-439b-8d9a-08ce11ff489f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041423 Jan 28 20:29:43.137901 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 226/473] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:43 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:43.205632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b391ea10-c2a3-4f10-bc79-f3cf95f25c61 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:43.206385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b391ea10-c2a3-4f10-bc79-f3cf95f25c61 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:43.213032 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b391ea10-c2a3-4f10-bc79-f3cf95f25c61 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:43.213473 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b391ea10-c2a3-4f10-bc79-f3cf95f25c61 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:43.214290 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b391ea10-c2a3-4f10-bc79-f3cf95f25c61 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:43.214721 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b391ea10-c2a3-4f10-bc79-f3cf95f25c61 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:43.349130 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b391ea10-c2a3-4f10-bc79-f3cf95f25c61 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:43.356953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b391ea10-c2a3-4f10-bc79-f3cf95f25c61 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.154899 Jan 28 20:29:43.357519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 248/474] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:43 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:43.904741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-082e285d-146c-4fc5-b38e-c58f3700b7f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:43.905368 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-082e285d-146c-4fc5-b38e-c58f3700b7f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:43.911376 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-082e285d-146c-4fc5-b38e-c58f3700b7f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:43.911822 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-082e285d-146c-4fc5-b38e-c58f3700b7f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:43.912597 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-082e285d-146c-4fc5-b38e-c58f3700b7f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:43.913032 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-082e285d-146c-4fc5-b38e-c58f3700b7f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:44.059422 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-082e285d-146c-4fc5-b38e-c58f3700b7f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:44.067445 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-082e285d-146c-4fc5-b38e-c58f3700b7f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.167093 Jan 28 20:29:44.068290 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 227/475] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:43 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:44.148390 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d6b72639-c0cc-483b-ae2e-13e4f3e1b669 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:44.149446 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d6b72639-c0cc-483b-ae2e-13e4f3e1b669 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:44.155619 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6b72639-c0cc-483b-ae2e-13e4f3e1b669 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:44.156062 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6b72639-c0cc-483b-ae2e-13e4f3e1b669 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:44.156834 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6b72639-c0cc-483b-ae2e-13e4f3e1b669 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:44.157271 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6b72639-c0cc-483b-ae2e-13e4f3e1b669 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:44.186475 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d6b72639-c0cc-483b-ae2e-13e4f3e1b669 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041750 Jan 28 20:29:44.187035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 249/476] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:44 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:44.373101 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-06ebeb0f-bb40-446b-9b4d-144dc180c177 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:44.373740 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-06ebeb0f-bb40-446b-9b4d-144dc180c177 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:44.379970 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06ebeb0f-bb40-446b-9b4d-144dc180c177 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:44.380419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06ebeb0f-bb40-446b-9b4d-144dc180c177 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:44.381283 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06ebeb0f-bb40-446b-9b4d-144dc180c177 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:44.381626 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06ebeb0f-bb40-446b-9b4d-144dc180c177 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:44.513826 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-06ebeb0f-bb40-446b-9b4d-144dc180c177 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:44.521213 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-06ebeb0f-bb40-446b-9b4d-144dc180c177 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.152217 Jan 28 20:29:44.521779 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 228/477] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:44 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:45.084643 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-89060c2c-4d84-4a87-8588-a5e4fc040847 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:45.085234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-89060c2c-4d84-4a87-8588-a5e4fc040847 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:45.091991 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-89060c2c-4d84-4a87-8588-a5e4fc040847 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:45.092435 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-89060c2c-4d84-4a87-8588-a5e4fc040847 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:45.093205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-89060c2c-4d84-4a87-8588-a5e4fc040847 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:45.093635 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-89060c2c-4d84-4a87-8588-a5e4fc040847 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:45.198274 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a38fe5e7-60b8-42b7-8c70-ab8ae9f9fd95 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:45.199324 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a38fe5e7-60b8-42b7-8c70-ab8ae9f9fd95 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:45.205026 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a38fe5e7-60b8-42b7-8c70-ab8ae9f9fd95 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:45.205604 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a38fe5e7-60b8-42b7-8c70-ab8ae9f9fd95 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:45.206475 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a38fe5e7-60b8-42b7-8c70-ab8ae9f9fd95 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:45.207003 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a38fe5e7-60b8-42b7-8c70-ab8ae9f9fd95 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:45.224814 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-89060c2c-4d84-4a87-8588-a5e4fc040847 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:45.232527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-89060c2c-4d84-4a87-8588-a5e4fc040847 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.151440 Jan 28 20:29:45.233129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 250/478] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:45 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:45.239924 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a38fe5e7-60b8-42b7-8c70-ab8ae9f9fd95 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045882 Jan 28 20:29:45.240479 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 229/479] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:45 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:29:45.537971 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9c8a367e-297d-4a8f-81b6-207467695627 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:45.538609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9c8a367e-297d-4a8f-81b6-207467695627 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:45.545110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9c8a367e-297d-4a8f-81b6-207467695627 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:45.545550 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9c8a367e-297d-4a8f-81b6-207467695627 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:45.546367 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9c8a367e-297d-4a8f-81b6-207467695627 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:45.546801 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9c8a367e-297d-4a8f-81b6-207467695627 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:45.682612 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9c8a367e-297d-4a8f-81b6-207467695627 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:45.689905 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9c8a367e-297d-4a8f-81b6-207467695627 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.155549 Jan 28 20:29:45.690403 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 251/480] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:45 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:46.249735 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4a742a23-0b16-4b6e-99ad-fd6263d29895 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:46.250299 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4a742a23-0b16-4b6e-99ad-fd6263d29895 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:46.250868 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-56251380-0ba0-4358-bb0a-ae10166f3354 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:46.251785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-56251380-0ba0-4358-bb0a-ae10166f3354 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:46.256458 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4a742a23-0b16-4b6e-99ad-fd6263d29895 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:46.256907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4a742a23-0b16-4b6e-99ad-fd6263d29895 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:46.257681 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4a742a23-0b16-4b6e-99ad-fd6263d29895 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:46.258139 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4a742a23-0b16-4b6e-99ad-fd6263d29895 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:46.258260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-56251380-0ba0-4358-bb0a-ae10166f3354 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:46.258708 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-56251380-0ba0-4358-bb0a-ae10166f3354 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:46.259492 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-56251380-0ba0-4358-bb0a-ae10166f3354 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:46.260631 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-56251380-0ba0-4358-bb0a-ae10166f3354 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:46.289052 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-56251380-0ba0-4358-bb0a-ae10166f3354 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041854 Jan 28 20:29:46.289622 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 252/481] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:46 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:29:46.387538 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4a742a23-0b16-4b6e-99ad-fd6263d29895 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:46.395247 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4a742a23-0b16-4b6e-99ad-fd6263d29895 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.149252 Jan 28 20:29:46.395804 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 230/482] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:46 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:46.706284 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-63534ae7-b063-4d0e-9b2b-a7138f15b8f5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:46.706888 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-63534ae7-b063-4d0e-9b2b-a7138f15b8f5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:46.712710 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-63534ae7-b063-4d0e-9b2b-a7138f15b8f5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:46.713163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-63534ae7-b063-4d0e-9b2b-a7138f15b8f5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:46.713954 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-63534ae7-b063-4d0e-9b2b-a7138f15b8f5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:46.714389 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-63534ae7-b063-4d0e-9b2b-a7138f15b8f5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:46.852791 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-63534ae7-b063-4d0e-9b2b-a7138f15b8f5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:46.860859 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-63534ae7-b063-4d0e-9b2b-a7138f15b8f5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.158136 Jan 28 20:29:46.861428 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 253/483] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:46 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:47.300387 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-310e10fe-c37b-4e01-be4a-abe205994c64 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:47.301542 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-310e10fe-c37b-4e01-be4a-abe205994c64 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:47.308234 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-310e10fe-c37b-4e01-be4a-abe205994c64 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:47.308703 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-310e10fe-c37b-4e01-be4a-abe205994c64 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:47.309710 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-310e10fe-c37b-4e01-be4a-abe205994c64 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:47.310161 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-310e10fe-c37b-4e01-be4a-abe205994c64 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:47.339980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-310e10fe-c37b-4e01-be4a-abe205994c64 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 Jan 28 20:29:47.340530 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 231/484] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:47 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:47.410924 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-79dfa424-f6be-4678-8cf7-5ced7fdca5be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:47.411518 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-79dfa424-f6be-4678-8cf7-5ced7fdca5be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:47.418164 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-79dfa424-f6be-4678-8cf7-5ced7fdca5be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:47.418611 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-79dfa424-f6be-4678-8cf7-5ced7fdca5be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:47.419372 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-79dfa424-f6be-4678-8cf7-5ced7fdca5be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:47.419795 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-79dfa424-f6be-4678-8cf7-5ced7fdca5be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:47.551125 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-79dfa424-f6be-4678-8cf7-5ced7fdca5be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:47.558934 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-79dfa424-f6be-4678-8cf7-5ced7fdca5be tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.151667 Jan 28 20:29:47.559468 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 254/485] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:47 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:47.878620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ca7bddb5-d7fc-4f34-b4a5-809f0f4f20af tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:47.879143 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ca7bddb5-d7fc-4f34-b4a5-809f0f4f20af tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:47.885733 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ca7bddb5-d7fc-4f34-b4a5-809f0f4f20af tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:47.886207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ca7bddb5-d7fc-4f34-b4a5-809f0f4f20af tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:47.886971 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ca7bddb5-d7fc-4f34-b4a5-809f0f4f20af tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:47.887398 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ca7bddb5-d7fc-4f34-b4a5-809f0f4f20af tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:48.018727 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ca7bddb5-d7fc-4f34-b4a5-809f0f4f20af tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:48.025910 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ca7bddb5-d7fc-4f34-b4a5-809f0f4f20af tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.151042 Jan 28 20:29:48.026461 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 232/486] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:47 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:48.350968 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bd6aefa4-f5ff-4e10-a91a-c364f99f6a54 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:48.351877 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bd6aefa4-f5ff-4e10-a91a-c364f99f6a54 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:48.358189 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bd6aefa4-f5ff-4e10-a91a-c364f99f6a54 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:48.358634 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bd6aefa4-f5ff-4e10-a91a-c364f99f6a54 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:48.359420 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bd6aefa4-f5ff-4e10-a91a-c364f99f6a54 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:48.359850 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bd6aefa4-f5ff-4e10-a91a-c364f99f6a54 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:48.395971 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bd6aefa4-f5ff-4e10-a91a-c364f99f6a54 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048685 Jan 28 20:29:48.396471 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 255/487] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:48 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:29:48.575450 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-92b0695a-e348-4822-ac4b-d2398c1bd4a3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:48.576062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-92b0695a-e348-4822-ac4b-d2398c1bd4a3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:48.582551 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-92b0695a-e348-4822-ac4b-d2398c1bd4a3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:48.582998 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-92b0695a-e348-4822-ac4b-d2398c1bd4a3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:48.583781 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-92b0695a-e348-4822-ac4b-d2398c1bd4a3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:48.584223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-92b0695a-e348-4822-ac4b-d2398c1bd4a3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:48.723934 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-92b0695a-e348-4822-ac4b-d2398c1bd4a3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:48.732388 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-92b0695a-e348-4822-ac4b-d2398c1bd4a3 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.160640 Jan 28 20:29:48.732947 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 233/488] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:48 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:49.043118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ab965f57-cd7d-4fe0-b98e-61d722e08dbc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:49.043717 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ab965f57-cd7d-4fe0-b98e-61d722e08dbc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:49.049964 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ab965f57-cd7d-4fe0-b98e-61d722e08dbc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:49.050411 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ab965f57-cd7d-4fe0-b98e-61d722e08dbc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:49.051181 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ab965f57-cd7d-4fe0-b98e-61d722e08dbc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:49.051612 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ab965f57-cd7d-4fe0-b98e-61d722e08dbc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:49.183361 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ab965f57-cd7d-4fe0-b98e-61d722e08dbc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:49.193895 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ab965f57-cd7d-4fe0-b98e-61d722e08dbc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.154345 Jan 28 20:29:49.194536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 256/489] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:49 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:49.408613 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cc935114-ab65-4ebf-859f-f30bef974896 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:49.409432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cc935114-ab65-4ebf-859f-f30bef974896 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:49.416322 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cc935114-ab65-4ebf-859f-f30bef974896 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:49.416761 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cc935114-ab65-4ebf-859f-f30bef974896 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:49.417549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cc935114-ab65-4ebf-859f-f30bef974896 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:49.418006 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cc935114-ab65-4ebf-859f-f30bef974896 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:49.449099 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cc935114-ab65-4ebf-859f-f30bef974896 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Jan 28 20:29:49.449833 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 234/490] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:49 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:29:49.749550 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-691f77a2-58b9-4166-94c9-bdef9e8334c9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:49.750300 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-691f77a2-58b9-4166-94c9-bdef9e8334c9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:49.756127 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-691f77a2-58b9-4166-94c9-bdef9e8334c9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:49.756653 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-691f77a2-58b9-4166-94c9-bdef9e8334c9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:49.757505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-691f77a2-58b9-4166-94c9-bdef9e8334c9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:49.758047 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-691f77a2-58b9-4166-94c9-bdef9e8334c9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:49.896733 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-691f77a2-58b9-4166-94c9-bdef9e8334c9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:49.904818 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-691f77a2-58b9-4166-94c9-bdef9e8334c9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.159016 Jan 28 20:29:49.905380 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 257/491] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:49 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:50.210653 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4f686df8-1eed-4188-852a-49655e8264dd tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:50.211238 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4f686df8-1eed-4188-852a-49655e8264dd tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:50.217862 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f686df8-1eed-4188-852a-49655e8264dd tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:50.218336 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f686df8-1eed-4188-852a-49655e8264dd tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:50.219105 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f686df8-1eed-4188-852a-49655e8264dd tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:50.219537 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f686df8-1eed-4188-852a-49655e8264dd tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:50.350125 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4f686df8-1eed-4188-852a-49655e8264dd tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:50.357254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4f686df8-1eed-4188-852a-49655e8264dd tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.150200 Jan 28 20:29:50.357814 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 235/492] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:50 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:50.460503 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3c3b5917-efd4-4011-9eec-4bd94a7be8fa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:50.461486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3c3b5917-efd4-4011-9eec-4bd94a7be8fa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:50.467785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c3b5917-efd4-4011-9eec-4bd94a7be8fa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:50.468222 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c3b5917-efd4-4011-9eec-4bd94a7be8fa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:50.468994 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c3b5917-efd4-4011-9eec-4bd94a7be8fa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:50.469421 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c3b5917-efd4-4011-9eec-4bd94a7be8fa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:50.497989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3c3b5917-efd4-4011-9eec-4bd94a7be8fa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041206 Jan 28 20:29:50.498544 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 258/493] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:29:50 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 20:29:50.650039 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1010464632", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "networks": [{"uuid": "f7cd137c-ce2e-4c82-9033-a14c7af1ce8b"}]}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:29:50.700577 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] validate_networks() for [('f7cd137c-ce2e-4c82-9033-a14c7af1ce8b', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:29:50.922488 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a1d1064b-612d-41d3-bb4f-a65f4c3f16ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:50.923192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a1d1064b-612d-41d3-bb4f-a65f4c3f16ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:50.929262 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a1d1064b-612d-41d3-bb4f-a65f4c3f16ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:50.929778 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a1d1064b-612d-41d3-bb4f-a65f4c3f16ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:50.930665 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a1d1064b-612d-41d3-bb4f-a65f4c3f16ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:50.931446 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a1d1064b-612d-41d3-bb4f-a65f4c3f16ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:51.130835 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a1d1064b-612d-41d3-bb4f-a65f4c3f16ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:51.139327 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a1d1064b-612d-41d3-bb4f-a65f4c3f16ea tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.220445 Jan 28 20:29:51.140184 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 259/494] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:50 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:29:51.328725 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:29:51.329129 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:29:51.329600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:29:51.330036 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:29:51.330445 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:29:51.339397 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:51.339838 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:51.340645 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:51.341076 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:51.357293 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Getting quotas for project d73cfa908e094fa0b8fbc1e550e29d20. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:29:51.361132 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Getting quotas for user 588b4e7353d2411ca853605fa586c8e8 and project d73cfa908e094fa0b8fbc1e550e29d20. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:29:51.372338 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:29:51.374211 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2c88707c-f6da-442b-88ac-1fdc15fd3c8a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:51.374658 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:29:51.374851 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2c88707c-f6da-442b-88ac-1fdc15fd3c8a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:51.380518 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2c88707c-f6da-442b-88ac-1fdc15fd3c8a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:51.380900 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2c88707c-f6da-442b-88ac-1fdc15fd3c8a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:51.381760 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2c88707c-f6da-442b-88ac-1fdc15fd3c8a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:51.382213 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2c88707c-f6da-442b-88ac-1fdc15fd3c8a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:51.422702 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-36f8d067-ab25-4fff-a656-d96dd7ae834b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776031 Jan 28 20:29:51.423811 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 236/495] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:29:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:29:51.437612 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6f3f6948-296f-4e1f-a092-3bb00f7d35da tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:51.438255 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6f3f6948-296f-4e1f-a092-3bb00f7d35da tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:51.502684 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6f3f6948-296f-4e1f-a092-3bb00f7d35da tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:51.513442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6f3f6948-296f-4e1f-a092-3bb00f7d35da tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1218 microversion: 2.1 time: 0.079146 Jan 28 20:29:51.514339 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 237/496] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:51 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:29:51.547329 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2c88707c-f6da-442b-88ac-1fdc15fd3c8a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:51.554608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2c88707c-f6da-442b-88ac-1fdc15fd3c8a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.183913 Jan 28 20:29:51.555211 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 260/497] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:51 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:29:52.155849 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-65985657-cfdd-4df8-bf7d-db99e8478593 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:52.156384 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-65985657-cfdd-4df8-bf7d-db99e8478593 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:52.162778 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-65985657-cfdd-4df8-bf7d-db99e8478593 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:52.163224 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-65985657-cfdd-4df8-bf7d-db99e8478593 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:52.163994 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-65985657-cfdd-4df8-bf7d-db99e8478593 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:52.164422 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-65985657-cfdd-4df8-bf7d-db99e8478593 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:52.299923 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-65985657-cfdd-4df8-bf7d-db99e8478593 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:52.308089 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-65985657-cfdd-4df8-bf7d-db99e8478593 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.156167 Jan 28 20:29:52.308645 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 238/498] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:52 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:52.539002 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1961f41b-a4ed-4cd9-8630-2aa608e4b803 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:52.539610 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1961f41b-a4ed-4cd9-8630-2aa608e4b803 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:52.545825 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1961f41b-a4ed-4cd9-8630-2aa608e4b803 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:52.546302 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1961f41b-a4ed-4cd9-8630-2aa608e4b803 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:52.547072 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1961f41b-a4ed-4cd9-8630-2aa608e4b803 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:52.547503 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1961f41b-a4ed-4cd9-8630-2aa608e4b803 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:52.571608 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7f850e86-fdef-426d-8634-a9fe16c8101d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:52.572856 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7f850e86-fdef-426d-8634-a9fe16c8101d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:52.578566 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f850e86-fdef-426d-8634-a9fe16c8101d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:52.579005 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f850e86-fdef-426d-8634-a9fe16c8101d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:52.579778 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f850e86-fdef-426d-8634-a9fe16c8101d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:52.580207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f850e86-fdef-426d-8634-a9fe16c8101d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:52.608042 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1961f41b-a4ed-4cd9-8630-2aa608e4b803 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:52.616704 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1961f41b-a4ed-4cd9-8630-2aa608e4b803 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1222 microversion: 2.1 time: 0.081083 Jan 28 20:29:52.617697 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 261/499] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:52 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:52.712203 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7f850e86-fdef-426d-8634-a9fe16c8101d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:52.719824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7f850e86-fdef-426d-8634-a9fe16c8101d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.151823 Jan 28 20:29:52.720380 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 239/500] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:52 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:29:53.324090 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-fc00608f-e352-45a4-bb6e-dfe43a16b0a1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:53.324686 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-fc00608f-e352-45a4-bb6e-dfe43a16b0a1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:53.330455 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc00608f-e352-45a4-bb6e-dfe43a16b0a1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:53.330901 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc00608f-e352-45a4-bb6e-dfe43a16b0a1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:53.331663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc00608f-e352-45a4-bb6e-dfe43a16b0a1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:53.332086 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc00608f-e352-45a4-bb6e-dfe43a16b0a1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:53.465027 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-fc00608f-e352-45a4-bb6e-dfe43a16b0a1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:53.472542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-fc00608f-e352-45a4-bb6e-dfe43a16b0a1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.152098 Jan 28 20:29:53.473105 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 262/501] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:53 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:53.633649 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-22845bf3-246d-49fa-a6cb-650de2c32caf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:53.634200 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-22845bf3-246d-49fa-a6cb-650de2c32caf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:53.641082 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-22845bf3-246d-49fa-a6cb-650de2c32caf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:53.641523 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-22845bf3-246d-49fa-a6cb-650de2c32caf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:53.642324 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-22845bf3-246d-49fa-a6cb-650de2c32caf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:53.642748 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-22845bf3-246d-49fa-a6cb-650de2c32caf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:53.702526 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-22845bf3-246d-49fa-a6cb-650de2c32caf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:53.709639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-22845bf3-246d-49fa-a6cb-650de2c32caf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1222 microversion: 2.1 time: 0.079697 Jan 28 20:29:53.710216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 240/502] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:53 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:53.736066 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-dc92d680-b320-4931-ae12-c0f618f8764f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:53.736662 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-dc92d680-b320-4931-ae12-c0f618f8764f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:53.742786 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dc92d680-b320-4931-ae12-c0f618f8764f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:53.743227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dc92d680-b320-4931-ae12-c0f618f8764f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:53.744604 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dc92d680-b320-4931-ae12-c0f618f8764f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:53.745028 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dc92d680-b320-4931-ae12-c0f618f8764f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:53.876713 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-dc92d680-b320-4931-ae12-c0f618f8764f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:53.883919 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-dc92d680-b320-4931-ae12-c0f618f8764f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.151354 Jan 28 20:29:53.885201 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 263/503] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:53 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:54.489040 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c5762000-d9fc-4c89-bb3d-1d460c16145b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:54.489645 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c5762000-d9fc-4c89-bb3d-1d460c16145b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:54.496023 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5762000-d9fc-4c89-bb3d-1d460c16145b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:54.496471 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5762000-d9fc-4c89-bb3d-1d460c16145b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:54.497243 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5762000-d9fc-4c89-bb3d-1d460c16145b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:54.497669 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c5762000-d9fc-4c89-bb3d-1d460c16145b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:54.631113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c5762000-d9fc-4c89-bb3d-1d460c16145b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:54.639284 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c5762000-d9fc-4c89-bb3d-1d460c16145b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.153894 Jan 28 20:29:54.639866 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 241/504] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:54 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:54.726418 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9463ab2c-98ff-4576-b5b4-584f6099a8b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:54.727025 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9463ab2c-98ff-4576-b5b4-584f6099a8b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:54.733479 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9463ab2c-98ff-4576-b5b4-584f6099a8b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:54.733951 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9463ab2c-98ff-4576-b5b4-584f6099a8b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:54.734725 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9463ab2c-98ff-4576-b5b4-584f6099a8b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:54.735155 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9463ab2c-98ff-4576-b5b4-584f6099a8b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:54.792288 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9463ab2c-98ff-4576-b5b4-584f6099a8b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:54.799356 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9463ab2c-98ff-4576-b5b4-584f6099a8b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1222 microversion: 2.1 time: 0.076570 Jan 28 20:29:54.799915 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 264/505] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:54 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:54.902429 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dc7befd0-e7e4-4fdf-98f2-64bfeccb22e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:54.902971 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dc7befd0-e7e4-4fdf-98f2-64bfeccb22e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:54.909430 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc7befd0-e7e4-4fdf-98f2-64bfeccb22e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:54.909898 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc7befd0-e7e4-4fdf-98f2-64bfeccb22e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:54.910754 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc7befd0-e7e4-4fdf-98f2-64bfeccb22e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:54.911185 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc7befd0-e7e4-4fdf-98f2-64bfeccb22e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:55.072829 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dc7befd0-e7e4-4fdf-98f2-64bfeccb22e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:55.080403 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dc7befd0-e7e4-4fdf-98f2-64bfeccb22e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.183056 Jan 28 20:29:55.080963 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 242/506] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:54 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:55.656804 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-58d760e2-97b3-468e-95fb-ba006583ad62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:55.658006 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-58d760e2-97b3-468e-95fb-ba006583ad62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:55.664127 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-58d760e2-97b3-468e-95fb-ba006583ad62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:55.664568 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-58d760e2-97b3-468e-95fb-ba006583ad62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:55.665350 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-58d760e2-97b3-468e-95fb-ba006583ad62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:55.666424 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-58d760e2-97b3-468e-95fb-ba006583ad62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:55.799330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-58d760e2-97b3-468e-95fb-ba006583ad62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:55.807536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-58d760e2-97b3-468e-95fb-ba006583ad62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.154496 Jan 28 20:29:55.808091 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 265/507] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:55 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:55.815545 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-19baefc9-1d7d-478b-abad-9316d213972d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:55.816152 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-19baefc9-1d7d-478b-abad-9316d213972d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:55.822342 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19baefc9-1d7d-478b-abad-9316d213972d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:55.822785 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19baefc9-1d7d-478b-abad-9316d213972d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:55.823560 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19baefc9-1d7d-478b-abad-9316d213972d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:55.823988 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19baefc9-1d7d-478b-abad-9316d213972d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:55.882501 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-19baefc9-1d7d-478b-abad-9316d213972d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:55.889603 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-19baefc9-1d7d-478b-abad-9316d213972d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1276 microversion: 2.1 time: 0.077602 Jan 28 20:29:55.890208 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 243/508] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:55 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1276 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:56.096964 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-435ba0be-1a02-4aac-91e5-0e6450869179 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:56.097717 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-435ba0be-1a02-4aac-91e5-0e6450869179 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:56.104117 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-435ba0be-1a02-4aac-91e5-0e6450869179 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:56.104619 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-435ba0be-1a02-4aac-91e5-0e6450869179 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:56.105622 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-435ba0be-1a02-4aac-91e5-0e6450869179 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:56.105847 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-435ba0be-1a02-4aac-91e5-0e6450869179 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:56.246221 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-435ba0be-1a02-4aac-91e5-0e6450869179 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:56.253392 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-435ba0be-1a02-4aac-91e5-0e6450869179 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.160270 Jan 28 20:29:56.253981 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 266/509] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:56 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:56.827700 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-98eea412-76eb-4bec-8c54-87a1d5bef5f6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:56.828432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-98eea412-76eb-4bec-8c54-87a1d5bef5f6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:56.835316 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98eea412-76eb-4bec-8c54-87a1d5bef5f6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:56.835844 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98eea412-76eb-4bec-8c54-87a1d5bef5f6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:56.836643 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98eea412-76eb-4bec-8c54-87a1d5bef5f6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:56.837850 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98eea412-76eb-4bec-8c54-87a1d5bef5f6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:56.907021 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e139d3ee-33a8-46a1-83d9-bf89dbcdced1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:56.912986 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e139d3ee-33a8-46a1-83d9-bf89dbcdced1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:56.920748 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e139d3ee-33a8-46a1-83d9-bf89dbcdced1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:56.921185 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e139d3ee-33a8-46a1-83d9-bf89dbcdced1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:56.922180 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e139d3ee-33a8-46a1-83d9-bf89dbcdced1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:56.922644 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e139d3ee-33a8-46a1-83d9-bf89dbcdced1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:57.013818 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-98eea412-76eb-4bec-8c54-87a1d5bef5f6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:57.023314 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-98eea412-76eb-4bec-8c54-87a1d5bef5f6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.199270 Jan 28 20:29:57.024174 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 244/510] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:56 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:57.083573 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e139d3ee-33a8-46a1-83d9-bf89dbcdced1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:57.092540 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e139d3ee-33a8-46a1-83d9-bf89dbcdced1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.188941 Jan 28 20:29:57.093588 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 267/511] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:56 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:29:57.106138 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-b9a04392-0acf-4a70-bb6f-3f13d8f253b3 req-63a7d402-7b69-4660-928d-0904b8a3f4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9423ae-529f-43f9-aee3-3f0e26568c2d", "tag": "7729b1e2-04d5-4718-a7e9-ae9ecf6b8332"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:29:57.107773 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:29:57.107773 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:29:57.114447 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-b9a04392-0acf-4a70-bb6f-3f13d8f253b3 req-63a7d402-7b69-4660-928d-0904b8a3f4e3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:57.114961 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-b9a04392-0acf-4a70-bb6f-3f13d8f253b3 req-63a7d402-7b69-4660-928d-0904b8a3f4e3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:57.129860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-b9a04392-0acf-4a70-bb6f-3f13d8f253b3 req-63a7d402-7b69-4660-928d-0904b8a3f4e3 service nova] Creating event network-changed:7729b1e2-04d5-4718-a7e9-ae9ecf6b8332 for instance ea9423ae-529f-43f9-aee3-3f0e26568c2d on hv-cinder-82635 Jan 28 20:29:57.137509 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-b9a04392-0acf-4a70-bb6f-3f13d8f253b3 req-63a7d402-7b69-4660-928d-0904b8a3f4e3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035056 Jan 28 20:29:57.138178 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 245/512] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:29:57.270279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3862ea73-901c-4d8b-9f09-a4b9e2880e1a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:57.270802 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3862ea73-901c-4d8b-9f09-a4b9e2880e1a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:57.276604 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3862ea73-901c-4d8b-9f09-a4b9e2880e1a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:57.277047 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3862ea73-901c-4d8b-9f09-a4b9e2880e1a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:57.278108 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3862ea73-901c-4d8b-9f09-a4b9e2880e1a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:57.278537 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3862ea73-901c-4d8b-9f09-a4b9e2880e1a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:57.419339 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3862ea73-901c-4d8b-9f09-a4b9e2880e1a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:57.426574 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3862ea73-901c-4d8b-9f09-a4b9e2880e1a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1277 microversion: 2.1 time: 0.160122 Jan 28 20:29:57.427219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 268/513] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:57 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:58.041410 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-34c7eff2-570f-4188-b415-10d6abd84a77 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:58.042181 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-34c7eff2-570f-4188-b415-10d6abd84a77 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:58.048673 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-34c7eff2-570f-4188-b415-10d6abd84a77 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:58.049116 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-34c7eff2-570f-4188-b415-10d6abd84a77 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:58.049938 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-34c7eff2-570f-4188-b415-10d6abd84a77 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:58.050375 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-34c7eff2-570f-4188-b415-10d6abd84a77 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:58.108556 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4aa77731-b541-41b2-b449-c4a4dc73eb92 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:58.109329 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4aa77731-b541-41b2-b449-c4a4dc73eb92 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:58.117557 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4aa77731-b541-41b2-b449-c4a4dc73eb92 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:58.118096 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4aa77731-b541-41b2-b449-c4a4dc73eb92 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:58.119126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4aa77731-b541-41b2-b449-c4a4dc73eb92 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:58.119813 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4aa77731-b541-41b2-b449-c4a4dc73eb92 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:58.254186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-34c7eff2-570f-4188-b415-10d6abd84a77 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:58.262081 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-34c7eff2-570f-4188-b415-10d6abd84a77 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.225080 Jan 28 20:29:58.266041 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 246/514] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:58 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:58.344979 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4aa77731-b541-41b2-b449-c4a4dc73eb92 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:58.354131 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4aa77731-b541-41b2-b449-c4a4dc73eb92 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.248277 Jan 28 20:29:58.355081 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 269/515] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:58 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:58.443927 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f79178c0-043d-4ec7-98f2-87b6e95f633b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:58.444543 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f79178c0-043d-4ec7-98f2-87b6e95f633b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:58.450506 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f79178c0-043d-4ec7-98f2-87b6e95f633b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:58.450958 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f79178c0-043d-4ec7-98f2-87b6e95f633b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:58.451738 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f79178c0-043d-4ec7-98f2-87b6e95f633b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:58.452177 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f79178c0-043d-4ec7-98f2-87b6e95f633b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:58.588662 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f79178c0-043d-4ec7-98f2-87b6e95f633b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:58.595951 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f79178c0-043d-4ec7-98f2-87b6e95f633b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.155723 Jan 28 20:29:58.596520 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 247/516] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:58 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:59.279359 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-dfe15d24-487b-4f3b-80af-c0b1083fa776 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:59.279959 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-dfe15d24-487b-4f3b-80af-c0b1083fa776 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:59.286063 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dfe15d24-487b-4f3b-80af-c0b1083fa776 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:59.286531 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dfe15d24-487b-4f3b-80af-c0b1083fa776 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:59.287289 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dfe15d24-487b-4f3b-80af-c0b1083fa776 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:59.287711 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dfe15d24-487b-4f3b-80af-c0b1083fa776 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:59.375285 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-20d291c4-cacc-4f1a-93d2-4ccf9b44d804 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:59.375896 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-20d291c4-cacc-4f1a-93d2-4ccf9b44d804 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:59.381867 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20d291c4-cacc-4f1a-93d2-4ccf9b44d804 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:59.382349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20d291c4-cacc-4f1a-93d2-4ccf9b44d804 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:59.383163 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20d291c4-cacc-4f1a-93d2-4ccf9b44d804 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:59.383649 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20d291c4-cacc-4f1a-93d2-4ccf9b44d804 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:59.419547 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-dfe15d24-487b-4f3b-80af-c0b1083fa776 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:59.427407 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-dfe15d24-487b-4f3b-80af-c0b1083fa776 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.152591 Jan 28 20:29:59.428084 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 270/517] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:59 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:29:59.515412 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-20d291c4-cacc-4f1a-93d2-4ccf9b44d804 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:59.522463 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-20d291c4-cacc-4f1a-93d2-4ccf9b44d804 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.150788 Jan 28 20:29:59.523019 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 248/518] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:59 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:29:59.611979 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3485833c-8aa4-402d-9128-61cb6d4b3e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:29:59.612576 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3485833c-8aa4-402d-9128-61cb6d4b3e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:29:59.618561 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3485833c-8aa4-402d-9128-61cb6d4b3e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:59.618999 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3485833c-8aa4-402d-9128-61cb6d4b3e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:59.619772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3485833c-8aa4-402d-9128-61cb6d4b3e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:29:59.620184 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3485833c-8aa4-402d-9128-61cb6d4b3e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:29:59.753700 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3485833c-8aa4-402d-9128-61cb6d4b3e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:29:59.761439 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3485833c-8aa4-402d-9128-61cb6d4b3e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.152969 Jan 28 20:29:59.762030 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 271/519] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:29:59 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:00.444289 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-fb920ce9-9602-4dfe-902b-faeaae0405eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:00.444977 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-fb920ce9-9602-4dfe-902b-faeaae0405eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:00.451479 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb920ce9-9602-4dfe-902b-faeaae0405eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:00.452014 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb920ce9-9602-4dfe-902b-faeaae0405eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:00.452881 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb920ce9-9602-4dfe-902b-faeaae0405eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:00.453313 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fb920ce9-9602-4dfe-902b-faeaae0405eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:00.539803 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-012ec147-c2a4-4c7d-9f07-ef4b522eaa8d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:00.540973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-012ec147-c2a4-4c7d-9f07-ef4b522eaa8d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:00.547227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-012ec147-c2a4-4c7d-9f07-ef4b522eaa8d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:00.547668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-012ec147-c2a4-4c7d-9f07-ef4b522eaa8d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:00.548451 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-012ec147-c2a4-4c7d-9f07-ef4b522eaa8d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:00.548877 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-012ec147-c2a4-4c7d-9f07-ef4b522eaa8d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:00.595613 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fb920ce9-9602-4dfe-902b-faeaae0405eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:00.603482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-fb920ce9-9602-4dfe-902b-faeaae0405eb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.163067 Jan 28 20:30:00.604048 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 249/520] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:00 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:00.686678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-012ec147-c2a4-4c7d-9f07-ef4b522eaa8d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:00.693773 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-012ec147-c2a4-4c7d-9f07-ef4b522eaa8d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.157659 Jan 28 20:30:00.694418 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 272/521] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:00 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:00.778264 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0ffd0e22-2d00-49b0-8244-836eac27f233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:00.778860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0ffd0e22-2d00-49b0-8244-836eac27f233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:00.784651 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ffd0e22-2d00-49b0-8244-836eac27f233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:00.785087 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ffd0e22-2d00-49b0-8244-836eac27f233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:00.785846 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ffd0e22-2d00-49b0-8244-836eac27f233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:00.786294 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ffd0e22-2d00-49b0-8244-836eac27f233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:00.916443 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-0ffd0e22-2d00-49b0-8244-836eac27f233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:00.923625 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0ffd0e22-2d00-49b0-8244-836eac27f233 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.149359 Jan 28 20:30:00.924187 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 250/522] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:00 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:01.086786 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-6642d139-f181-406c-aa87-d24b463595c8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:01.087410 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-6642d139-f181-406c-aa87-d24b463595c8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:01.093066 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6642d139-f181-406c-aa87-d24b463595c8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:01.093511 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6642d139-f181-406c-aa87-d24b463595c8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:01.094303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6642d139-f181-406c-aa87-d24b463595c8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:01.094731 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6642d139-f181-406c-aa87-d24b463595c8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:01.212561 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-6642d139-f181-406c-aa87-d24b463595c8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lazy-loading 'services' on Instance uuid 08dd8af5-ad5a-461a-b185-54130ae59903 {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:30:01.318518 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-6642d139-f181-406c-aa87-d24b463595c8 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "DELETE /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903/os-volume_attachments/83f327e4-a848-4c76-85ea-aba6360cda5c" status: 202 len: 0 microversion: 2.1 time: 0.235105 Jan 28 20:30:01.319120 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 273/523] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:30:01 2022] DELETE /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903/os-volume_attachments/83f327e4-a848-4c76-85ea-aba6360cda5c => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:30:01.620427 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d17d0d9c-c55b-41c9-b4df-5ed3db6f963d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:01.620957 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d17d0d9c-c55b-41c9-b4df-5ed3db6f963d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:01.627182 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d17d0d9c-c55b-41c9-b4df-5ed3db6f963d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:01.627620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d17d0d9c-c55b-41c9-b4df-5ed3db6f963d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:01.628386 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d17d0d9c-c55b-41c9-b4df-5ed3db6f963d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:01.628812 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d17d0d9c-c55b-41c9-b4df-5ed3db6f963d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:01.710955 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-96cc95fa-e895-4b8f-addc-4dedb5cd6f67 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:01.711649 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-96cc95fa-e895-4b8f-addc-4dedb5cd6f67 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:01.718263 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-96cc95fa-e895-4b8f-addc-4dedb5cd6f67 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:01.718705 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-96cc95fa-e895-4b8f-addc-4dedb5cd6f67 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:01.719482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-96cc95fa-e895-4b8f-addc-4dedb5cd6f67 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:01.719911 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-96cc95fa-e895-4b8f-addc-4dedb5cd6f67 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:01.769064 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d17d0d9c-c55b-41c9-b4df-5ed3db6f963d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:01.776856 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d17d0d9c-c55b-41c9-b4df-5ed3db6f963d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.160532 Jan 28 20:30:01.777619 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 251/524] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:01 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:01.857828 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-96cc95fa-e895-4b8f-addc-4dedb5cd6f67 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:01.864984 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-96cc95fa-e895-4b8f-addc-4dedb5cd6f67 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.158427 Jan 28 20:30:01.865545 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 274/525] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:01 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:01.940594 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1dfd2668-e931-4883-a40d-2b9f503f871e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:01.941200 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1dfd2668-e931-4883-a40d-2b9f503f871e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:01.946975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1dfd2668-e931-4883-a40d-2b9f503f871e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:01.947425 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1dfd2668-e931-4883-a40d-2b9f503f871e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:01.948197 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1dfd2668-e931-4883-a40d-2b9f503f871e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:01.948631 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1dfd2668-e931-4883-a40d-2b9f503f871e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:02.085729 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1dfd2668-e931-4883-a40d-2b9f503f871e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:02.093657 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1dfd2668-e931-4883-a40d-2b9f503f871e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.156592 Jan 28 20:30:02.094267 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 252/526] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:01 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:02.793592 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f2d04899-28db-4fad-bdcf-17162c9eb43e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:02.794263 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f2d04899-28db-4fad-bdcf-17162c9eb43e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:02.806005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f2d04899-28db-4fad-bdcf-17162c9eb43e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:02.806642 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f2d04899-28db-4fad-bdcf-17162c9eb43e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:02.808323 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f2d04899-28db-4fad-bdcf-17162c9eb43e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:02.808903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f2d04899-28db-4fad-bdcf-17162c9eb43e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:02.882136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-13fd8b79-a936-47e4-89a1-9dbfa75098b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:02.882736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-13fd8b79-a936-47e4-89a1-9dbfa75098b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:02.889603 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-13fd8b79-a936-47e4-89a1-9dbfa75098b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:02.890089 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-13fd8b79-a936-47e4-89a1-9dbfa75098b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:02.890869 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-13fd8b79-a936-47e4-89a1-9dbfa75098b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:02.891293 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-13fd8b79-a936-47e4-89a1-9dbfa75098b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:02.972406 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f2d04899-28db-4fad-bdcf-17162c9eb43e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:02.981317 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f2d04899-28db-4fad-bdcf-17162c9eb43e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.191377 Jan 28 20:30:02.982330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 275/527] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:02 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:03.040379 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-13fd8b79-a936-47e4-89a1-9dbfa75098b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:03.047617 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-13fd8b79-a936-47e4-89a1-9dbfa75098b0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.169073 Jan 28 20:30:03.048176 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 253/528] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:02 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:03.110500 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a269cef8-e424-4b4a-b849-9747e684863b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:03.111222 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a269cef8-e424-4b4a-b849-9747e684863b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:03.117361 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a269cef8-e424-4b4a-b849-9747e684863b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:03.117797 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a269cef8-e424-4b4a-b849-9747e684863b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:03.118615 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a269cef8-e424-4b4a-b849-9747e684863b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:03.119044 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a269cef8-e424-4b4a-b849-9747e684863b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:03.252467 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a269cef8-e424-4b4a-b849-9747e684863b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:03.259582 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a269cef8-e424-4b4a-b849-9747e684863b tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.153011 Jan 28 20:30:03.260171 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 276/529] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:03 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:03.477152 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-53dc6eb9-346e-49f5-9778-5afc792b8020 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:03.477645 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-53dc6eb9-346e-49f5-9778-5afc792b8020 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:03.483938 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-53dc6eb9-346e-49f5-9778-5afc792b8020 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:03.484501 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-53dc6eb9-346e-49f5-9778-5afc792b8020 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:03.485283 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-53dc6eb9-346e-49f5-9778-5afc792b8020 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:03.485714 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-53dc6eb9-346e-49f5-9778-5afc792b8020 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:03.509078 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-53dc6eb9-346e-49f5-9778-5afc792b8020 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:30:03.580173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-53dc6eb9-346e-49f5-9778-5afc792b8020 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "DELETE /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 204 len: 0 microversion: 2.1 time: 0.106343 Jan 28 20:30:03.580816 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 254/530] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:30:03 2022] DELETE /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:30:03.589588 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-22da4bb7-1004-434e-9cf1-b5e3b770e374 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:03.590221 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-22da4bb7-1004-434e-9cf1-b5e3b770e374 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:03.595923 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-22da4bb7-1004-434e-9cf1-b5e3b770e374 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:03.596359 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-22da4bb7-1004-434e-9cf1-b5e3b770e374 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:03.597157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-22da4bb7-1004-434e-9cf1-b5e3b770e374 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:03.597582 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-22da4bb7-1004-434e-9cf1-b5e3b770e374 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:03.727964 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-22da4bb7-1004-434e-9cf1-b5e3b770e374 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:03.735861 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-22da4bb7-1004-434e-9cf1-b5e3b770e374 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1512 microversion: 2.1 time: 0.150357 Jan 28 20:30:03.736437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 277/531] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:03 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:03.997833 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e58bfc4f-8cca-4b72-947b-30d421cdec04 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:03.998560 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e58bfc4f-8cca-4b72-947b-30d421cdec04 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:04.004858 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e58bfc4f-8cca-4b72-947b-30d421cdec04 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:04.005312 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e58bfc4f-8cca-4b72-947b-30d421cdec04 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:04.006202 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e58bfc4f-8cca-4b72-947b-30d421cdec04 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:04.006638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e58bfc4f-8cca-4b72-947b-30d421cdec04 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:04.064943 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-42c58afb-61a7-4d55-b935-09400c54d35e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:04.065487 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-42c58afb-61a7-4d55-b935-09400c54d35e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:04.071799 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-42c58afb-61a7-4d55-b935-09400c54d35e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:04.072252 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-42c58afb-61a7-4d55-b935-09400c54d35e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:04.073037 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-42c58afb-61a7-4d55-b935-09400c54d35e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:04.073471 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-42c58afb-61a7-4d55-b935-09400c54d35e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:04.171903 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e58bfc4f-8cca-4b72-947b-30d421cdec04 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:04.179675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e58bfc4f-8cca-4b72-947b-30d421cdec04 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1566 microversion: 2.1 time: 0.185851 Jan 28 20:30:04.180252 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 255/532] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:03 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:04.238973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-42c58afb-61a7-4d55-b935-09400c54d35e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:04.246625 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-42c58afb-61a7-4d55-b935-09400c54d35e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.185361 Jan 28 20:30:04.247190 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 278/533] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:04 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:04.276416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-46a42c0d-12fa-4798-8a73-a573196d7420 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:04.277341 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-46a42c0d-12fa-4798-8a73-a573196d7420 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:04.283110 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46a42c0d-12fa-4798-8a73-a573196d7420 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:04.283556 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46a42c0d-12fa-4798-8a73-a573196d7420 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:04.284333 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46a42c0d-12fa-4798-8a73-a573196d7420 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:04.284765 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46a42c0d-12fa-4798-8a73-a573196d7420 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:04.416799 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-46a42c0d-12fa-4798-8a73-a573196d7420 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:04.423966 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-46a42c0d-12fa-4798-8a73-a573196d7420 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.151551 Jan 28 20:30:04.424522 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 256/534] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:04 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:04.752796 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-55a48786-177e-4cc1-ae7f-76963d1cb592 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:04.753433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-55a48786-177e-4cc1-ae7f-76963d1cb592 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:04.759268 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-55a48786-177e-4cc1-ae7f-76963d1cb592 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:04.759713 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-55a48786-177e-4cc1-ae7f-76963d1cb592 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:04.760488 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-55a48786-177e-4cc1-ae7f-76963d1cb592 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:04.760921 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-55a48786-177e-4cc1-ae7f-76963d1cb592 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:04.893894 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-55a48786-177e-4cc1-ae7f-76963d1cb592 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:04.901130 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-55a48786-177e-4cc1-ae7f-76963d1cb592 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1512 microversion: 2.1 time: 0.151932 Jan 28 20:30:04.901694 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 279/535] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:04 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:05.196193 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f39187d8-d4ad-497e-9fe6-e408c59754b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:05.196806 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f39187d8-d4ad-497e-9fe6-e408c59754b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:05.202954 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f39187d8-d4ad-497e-9fe6-e408c59754b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.203402 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f39187d8-d4ad-497e-9fe6-e408c59754b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.204181 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f39187d8-d4ad-497e-9fe6-e408c59754b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.204610 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f39187d8-d4ad-497e-9fe6-e408c59754b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.262428 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-24b4f34e-fcf0-4727-9f77-6bf3edeb7ecf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:05.263242 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-24b4f34e-fcf0-4727-9f77-6bf3edeb7ecf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:05.269961 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-24b4f34e-fcf0-4727-9f77-6bf3edeb7ecf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.270415 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-24b4f34e-fcf0-4727-9f77-6bf3edeb7ecf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.271214 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-24b4f34e-fcf0-4727-9f77-6bf3edeb7ecf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.271643 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-24b4f34e-fcf0-4727-9f77-6bf3edeb7ecf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.386600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f39187d8-d4ad-497e-9fe6-e408c59754b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:05.394479 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f39187d8-d4ad-497e-9fe6-e408c59754b5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1546 microversion: 2.1 time: 0.201984 Jan 28 20:30:05.395050 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 257/536] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:05 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:05.411387 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4b5e4d08-40d8-47c9-9720-6063f80c21ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:05.411877 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4b5e4d08-40d8-47c9-9720-6063f80c21ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:05.419103 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b5e4d08-40d8-47c9-9720-6063f80c21ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.419813 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b5e4d08-40d8-47c9-9720-6063f80c21ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.431111 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b5e4d08-40d8-47c9-9720-6063f80c21ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.431715 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b5e4d08-40d8-47c9-9720-6063f80c21ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.463317 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-24b4f34e-fcf0-4727-9f77-6bf3edeb7ecf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:05.476453 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-24b4f34e-fcf0-4727-9f77-6bf3edeb7ecf tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.217583 Jan 28 20:30:05.477249 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 280/537] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:05 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:05.484314 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7a3ec5cf-7dad-4188-bb79-33a154bb1c0c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:05.485194 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7a3ec5cf-7dad-4188-bb79-33a154bb1c0c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:05.491385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7a3ec5cf-7dad-4188-bb79-33a154bb1c0c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.492055 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7a3ec5cf-7dad-4188-bb79-33a154bb1c0c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.492822 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7a3ec5cf-7dad-4188-bb79-33a154bb1c0c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.493254 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7a3ec5cf-7dad-4188-bb79-33a154bb1c0c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.521648 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-4b5e4d08-40d8-47c9-9720-6063f80c21ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] HTTP exception thrown: Cannot 'detach_volume' instance 0d03f1de-078d-4fff-aec4-7c91aaaa1eed while it is in vm_state rescued Jan 28 20:30:05.522397 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4b5e4d08-40d8-47c9-9720-6063f80c21ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Returning 409 to user: Cannot 'detach_volume' instance 0d03f1de-078d-4fff-aec4-7c91aaaa1eed while it is in vm_state rescued {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:30:05.523272 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4b5e4d08-40d8-47c9-9720-6063f80c21ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments/a18c9ce5-6038-4ab1-bcff-959b959dd1b5" status: 409 len: 152 microversion: 2.1 time: 0.115656 Jan 28 20:30:05.523815 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 258/538] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:30:05 2022] DELETE /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments/a18c9ce5-6038-4ab1-bcff-959b959dd1b5 => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 28 20:30:05.532344 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-62689755-decb-49ce-95e2-521d40e887d9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:05.532910 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-62689755-decb-49ce-95e2-521d40e887d9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:05.538919 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-62689755-decb-49ce-95e2-521d40e887d9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.539367 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-62689755-decb-49ce-95e2-521d40e887d9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.540154 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-62689755-decb-49ce-95e2-521d40e887d9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.540593 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-62689755-decb-49ce-95e2-521d40e887d9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.606844 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-62689755-decb-49ce-95e2-521d40e887d9 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/action" status: 202 len: 0 microversion: 2.1 time: 0.078057 Jan 28 20:30:05.611035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 259/539] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:30:05 2022] POST /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 20:30:05.617038 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b23f12fd-b11f-4959-92f4-478d8cc0fbb5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:05.618490 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b23f12fd-b11f-4959-92f4-478d8cc0fbb5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:05.626508 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b23f12fd-b11f-4959-92f4-478d8cc0fbb5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.627469 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b23f12fd-b11f-4959-92f4-478d8cc0fbb5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.628473 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b23f12fd-b11f-4959-92f4-478d8cc0fbb5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.629020 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b23f12fd-b11f-4959-92f4-478d8cc0fbb5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.651649 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7a3ec5cf-7dad-4188-bb79-33a154bb1c0c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:05.661186 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7a3ec5cf-7dad-4188-bb79-33a154bb1c0c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.182611 Jan 28 20:30:05.661764 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 281/540] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:05 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:05.778290 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b23f12fd-b11f-4959-92f4-478d8cc0fbb5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:05.788340 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b23f12fd-b11f-4959-92f4-478d8cc0fbb5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1554 microversion: 2.1 time: 0.175436 Jan 28 20:30:05.790205 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 260/541] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:05 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:05.918636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d7b87d6e-18bf-4873-976b-429002abbd17 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:05.919244 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d7b87d6e-18bf-4873-976b-429002abbd17 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:05.924894 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d7b87d6e-18bf-4873-976b-429002abbd17 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.925342 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d7b87d6e-18bf-4873-976b-429002abbd17 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:05.926143 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d7b87d6e-18bf-4873-976b-429002abbd17 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:05.926585 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d7b87d6e-18bf-4873-976b-429002abbd17 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:06.067756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d7b87d6e-18bf-4873-976b-429002abbd17 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:06.075106 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d7b87d6e-18bf-4873-976b-429002abbd17 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1512 microversion: 2.1 time: 0.160614 Jan 28 20:30:06.075920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 282/542] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:05 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:06.493580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f9d55cf2-e7cf-421b-a780-6a40c8b19de4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:06.494296 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f9d55cf2-e7cf-421b-a780-6a40c8b19de4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:06.501343 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f9d55cf2-e7cf-421b-a780-6a40c8b19de4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:06.501779 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f9d55cf2-e7cf-421b-a780-6a40c8b19de4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:06.502603 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f9d55cf2-e7cf-421b-a780-6a40c8b19de4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:06.503038 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f9d55cf2-e7cf-421b-a780-6a40c8b19de4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:06.592171 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-f0c2a619-378d-422b-a4ba-4bae684a43ce req-9a336ebe-aebd-40e0-845d-67dc284475e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dd8af5-ad5a-461a-b185-54130ae59903", "name": "network-vif-deleted", "tag": "68ef1535-e8b0-430f-a7e8-8b7631bf4fcc"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:06.595202 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:06.595202 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:30:06.609671 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-f0c2a619-378d-422b-a4ba-4bae684a43ce req-9a336ebe-aebd-40e0-845d-67dc284475e0 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:06.610747 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-f0c2a619-378d-422b-a4ba-4bae684a43ce req-9a336ebe-aebd-40e0-845d-67dc284475e0 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:06.623191 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-f0c2a619-378d-422b-a4ba-4bae684a43ce req-9a336ebe-aebd-40e0-845d-67dc284475e0 service nova] Creating event network-vif-deleted:68ef1535-e8b0-430f-a7e8-8b7631bf4fcc for instance 08dd8af5-ad5a-461a-b185-54130ae59903 on hv-cinder-82635 Jan 28 20:30:06.627926 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-f0c2a619-378d-422b-a4ba-4bae684a43ce req-9a336ebe-aebd-40e0-845d-67dc284475e0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039886 Jan 28 20:30:06.628535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 283/543] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:30:06.660690 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f9d55cf2-e7cf-421b-a780-6a40c8b19de4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:06.668880 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f9d55cf2-e7cf-421b-a780-6a40c8b19de4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.178883 Jan 28 20:30:06.669384 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 261/544] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:06 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:06.678797 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d7a77906-08b6-437c-8fd5-4e010947b03d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:06.679577 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d7a77906-08b6-437c-8fd5-4e010947b03d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:06.685670 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d7a77906-08b6-437c-8fd5-4e010947b03d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:06.686266 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d7a77906-08b6-437c-8fd5-4e010947b03d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:06.687074 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d7a77906-08b6-437c-8fd5-4e010947b03d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:06.687508 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d7a77906-08b6-437c-8fd5-4e010947b03d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:06.807886 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8c2ae184-4324-4735-87e8-e4ea92878880 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:06.808483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8c2ae184-4324-4735-87e8-e4ea92878880 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:06.814242 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c2ae184-4324-4735-87e8-e4ea92878880 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:06.814718 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c2ae184-4324-4735-87e8-e4ea92878880 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:06.815536 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c2ae184-4324-4735-87e8-e4ea92878880 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:06.816081 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c2ae184-4324-4735-87e8-e4ea92878880 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:06.823161 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d7a77906-08b6-437c-8fd5-4e010947b03d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:06.830352 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d7a77906-08b6-437c-8fd5-4e010947b03d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.155440 Jan 28 20:30:06.830920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 284/545] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:06 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:06.954788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8c2ae184-4324-4735-87e8-e4ea92878880 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:06.962401 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8c2ae184-4324-4735-87e8-e4ea92878880 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1554 microversion: 2.1 time: 0.158129 Jan 28 20:30:06.963047 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 262/546] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:06 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:07.092899 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:07.093460 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:07.099265 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:07.099703 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:07.100596 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:07.101205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:07.130420 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:07.130858 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:07.131520 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lazy-loading 'fault' on Instance uuid 08dd8af5-ad5a-461a-b185-54130ae59903 {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:30:07.170782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:07.177891 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3c86d920-08c9-4d4b-ac89-c135045800ff tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 200 len: 1307 microversion: 2.1 time: 0.089694 Jan 28 20:30:07.178463 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 285/547] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:07 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:07.685483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-43a130a4-27ae-44b8-81d0-64524053d448 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:07.687335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-43a130a4-27ae-44b8-81d0-64524053d448 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:07.692284 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-43a130a4-27ae-44b8-81d0-64524053d448 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:07.692720 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-43a130a4-27ae-44b8-81d0-64524053d448 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:07.693490 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-43a130a4-27ae-44b8-81d0-64524053d448 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:07.693938 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-43a130a4-27ae-44b8-81d0-64524053d448 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:07.825481 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-43a130a4-27ae-44b8-81d0-64524053d448 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:07.832489 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-43a130a4-27ae-44b8-81d0-64524053d448 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.150818 Jan 28 20:30:07.833048 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 263/548] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:07 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:07.847334 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a9553f33-78cc-46d5-a331-cd8cdd47b8a0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:07.847970 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a9553f33-78cc-46d5-a331-cd8cdd47b8a0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:07.854196 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a9553f33-78cc-46d5-a331-cd8cdd47b8a0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:07.854637 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a9553f33-78cc-46d5-a331-cd8cdd47b8a0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:07.855423 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a9553f33-78cc-46d5-a331-cd8cdd47b8a0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:07.855852 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a9553f33-78cc-46d5-a331-cd8cdd47b8a0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:07.981109 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7db1fc5f-699b-4664-b229-e471debdea57 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:07.981714 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7db1fc5f-699b-4664-b229-e471debdea57 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:07.987896 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a9553f33-78cc-46d5-a331-cd8cdd47b8a0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:07.993062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7db1fc5f-699b-4664-b229-e471debdea57 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:07.993680 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7db1fc5f-699b-4664-b229-e471debdea57 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:07.995052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7db1fc5f-699b-4664-b229-e471debdea57 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:07.995492 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7db1fc5f-699b-4664-b229-e471debdea57 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:07.995931 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a9553f33-78cc-46d5-a331-cd8cdd47b8a0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.152250 Jan 28 20:30:07.996498 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 286/549] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:07 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:08.125667 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7db1fc5f-699b-4664-b229-e471debdea57 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:08.133637 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7db1fc5f-699b-4664-b229-e471debdea57 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1554 microversion: 2.1 time: 0.156298 Jan 28 20:30:08.134224 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 264/550] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:07 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:08.195353 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-de1413cf-5651-4922-a8a7-fd108deb2b06 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:08.195890 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-de1413cf-5651-4922-a8a7-fd108deb2b06 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 08dd8af5-ad5a-461a-b185-54130ae59903] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:08.202179 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-de1413cf-5651-4922-a8a7-fd108deb2b06 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:08.202629 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-de1413cf-5651-4922-a8a7-fd108deb2b06 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:08.203403 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-de1413cf-5651-4922-a8a7-fd108deb2b06 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:08.203866 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-de1413cf-5651-4922-a8a7-fd108deb2b06 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:08.216693 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-de1413cf-5651-4922-a8a7-fd108deb2b06 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] HTTP exception thrown: Instance 08dd8af5-ad5a-461a-b185-54130ae59903 could not be found. Jan 28 20:30:08.217260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-de1413cf-5651-4922-a8a7-fd108deb2b06 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Returning 404 to user: Instance 08dd8af5-ad5a-461a-b185-54130ae59903 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:30:08.218104 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-de1413cf-5651-4922-a8a7-fd108deb2b06 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903" status: 404 len: 111 microversion: 2.1 time: 0.026442 Jan 28 20:30:08.218697 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 287/551] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:08 2022] GET /compute/v2.1/servers/08dd8af5-ad5a-461a-b185-54130ae59903 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:30:08.849930 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-fcaccd7c-00f9-4763-8cae-d4554608d30a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:08.850531 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-fcaccd7c-00f9-4763-8cae-d4554608d30a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:08.856722 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fcaccd7c-00f9-4763-8cae-d4554608d30a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:08.857161 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fcaccd7c-00f9-4763-8cae-d4554608d30a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:08.857955 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fcaccd7c-00f9-4763-8cae-d4554608d30a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:08.858374 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fcaccd7c-00f9-4763-8cae-d4554608d30a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:08.992315 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fcaccd7c-00f9-4763-8cae-d4554608d30a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:09.000030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-fcaccd7c-00f9-4763-8cae-d4554608d30a tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.153762 Jan 28 20:30:09.000634 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 265/552] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:08 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:09.012220 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-fc5abc06-2b13-427e-a6ea-42d413f02b65 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:09.012927 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-fc5abc06-2b13-427e-a6ea-42d413f02b65 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:09.019656 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc5abc06-2b13-427e-a6ea-42d413f02b65 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:09.020201 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc5abc06-2b13-427e-a6ea-42d413f02b65 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:09.021196 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc5abc06-2b13-427e-a6ea-42d413f02b65 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:09.021662 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc5abc06-2b13-427e-a6ea-42d413f02b65 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:09.151173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3f8004d1-84d0-49cf-be4a-fcc12328b1fe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:09.152453 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3f8004d1-84d0-49cf-be4a-fcc12328b1fe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:09.160407 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3f8004d1-84d0-49cf-be4a-fcc12328b1fe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:09.161086 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3f8004d1-84d0-49cf-be4a-fcc12328b1fe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:09.162447 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3f8004d1-84d0-49cf-be4a-fcc12328b1fe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:09.163188 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3f8004d1-84d0-49cf-be4a-fcc12328b1fe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:09.175138 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-fc5abc06-2b13-427e-a6ea-42d413f02b65 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:09.188677 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-fc5abc06-2b13-427e-a6ea-42d413f02b65 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.180053 Jan 28 20:30:09.190250 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 288/553] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:09 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:09.302602 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3f8004d1-84d0-49cf-be4a-fcc12328b1fe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:09.310853 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3f8004d1-84d0-49cf-be4a-fcc12328b1fe tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1554 microversion: 2.1 time: 0.163912 Jan 28 20:30:09.311543 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 266/554] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:09 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:09.525162 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-3f882ac5-11b8-4d71-81be-795d7639b2e6 req-a9077ace-16b4-4aa5-86c8-b1cf26339143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9423ae-529f-43f9-aee3-3f0e26568c2d", "name": "network-vif-plugged", "status": "completed", "tag": "7729b1e2-04d5-4718-a7e9-ae9ecf6b8332"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:09.527192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:09.527192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:30:09.534264 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-3f882ac5-11b8-4d71-81be-795d7639b2e6 req-a9077ace-16b4-4aa5-86c8-b1cf26339143 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:09.534762 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-3f882ac5-11b8-4d71-81be-795d7639b2e6 req-a9077ace-16b4-4aa5-86c8-b1cf26339143 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:09.546452 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-3f882ac5-11b8-4d71-81be-795d7639b2e6 req-a9077ace-16b4-4aa5-86c8-b1cf26339143 service nova] Creating event network-vif-plugged:7729b1e2-04d5-4718-a7e9-ae9ecf6b8332 for instance ea9423ae-529f-43f9-aee3-3f0e26568c2d on hv-cinder-82635 Jan 28 20:30:09.551184 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-3f882ac5-11b8-4d71-81be-795d7639b2e6 req-a9077ace-16b4-4aa5-86c8-b1cf26339143 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029598 Jan 28 20:30:09.551815 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 289/555] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:30:10.016724 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8c99bb7e-dcee-4e90-a067-500508492531 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:10.017335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8c99bb7e-dcee-4e90-a067-500508492531 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:10.023668 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c99bb7e-dcee-4e90-a067-500508492531 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:10.024116 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c99bb7e-dcee-4e90-a067-500508492531 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:10.024899 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c99bb7e-dcee-4e90-a067-500508492531 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:10.025327 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8c99bb7e-dcee-4e90-a067-500508492531 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:10.157027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8c99bb7e-dcee-4e90-a067-500508492531 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:10.164154 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8c99bb7e-dcee-4e90-a067-500508492531 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.151136 Jan 28 20:30:10.164721 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 267/556] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:10 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:10.206828 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8d6658d8-0058-4a33-a4fe-b8711162b0b3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:10.207508 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8d6658d8-0058-4a33-a4fe-b8711162b0b3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:10.213960 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8d6658d8-0058-4a33-a4fe-b8711162b0b3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:10.214402 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8d6658d8-0058-4a33-a4fe-b8711162b0b3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:10.215171 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8d6658d8-0058-4a33-a4fe-b8711162b0b3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:10.215592 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8d6658d8-0058-4a33-a4fe-b8711162b0b3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:10.328432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-33041ff8-bc20-41e0-9ce7-55fd26a58979 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:10.329030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-33041ff8-bc20-41e0-9ce7-55fd26a58979 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:10.334676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-33041ff8-bc20-41e0-9ce7-55fd26a58979 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:10.335120 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-33041ff8-bc20-41e0-9ce7-55fd26a58979 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:10.335888 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-33041ff8-bc20-41e0-9ce7-55fd26a58979 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:10.336330 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-33041ff8-bc20-41e0-9ce7-55fd26a58979 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:10.350892 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8d6658d8-0058-4a33-a4fe-b8711162b0b3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:10.358287 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8d6658d8-0058-4a33-a4fe-b8711162b0b3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.155771 Jan 28 20:30:10.358856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 290/557] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:10 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:10.466512 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-33041ff8-bc20-41e0-9ce7-55fd26a58979 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:10.480233 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-33041ff8-bc20-41e0-9ce7-55fd26a58979 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1554 microversion: 2.1 time: 0.154264 Jan 28 20:30:10.480828 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 268/558] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:10 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:11.182390 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-99c04591-569f-4846-9f59-d269ce56e286 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:11.182989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-99c04591-569f-4846-9f59-d269ce56e286 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:11.192839 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-99c04591-569f-4846-9f59-d269ce56e286 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:11.193279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-99c04591-569f-4846-9f59-d269ce56e286 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:11.194115 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-99c04591-569f-4846-9f59-d269ce56e286 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:11.194549 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-99c04591-569f-4846-9f59-d269ce56e286 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:11.337754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-99c04591-569f-4846-9f59-d269ce56e286 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:11.344958 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-99c04591-569f-4846-9f59-d269ce56e286 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.166321 Jan 28 20:30:11.345515 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 291/559] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:11 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:11.375306 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c73a046f-1102-41e5-85d3-3624b41197b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:11.375902 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c73a046f-1102-41e5-85d3-3624b41197b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:11.383252 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c73a046f-1102-41e5-85d3-3624b41197b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:11.383827 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c73a046f-1102-41e5-85d3-3624b41197b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:11.384745 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c73a046f-1102-41e5-85d3-3624b41197b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:11.385124 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c73a046f-1102-41e5-85d3-3624b41197b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:11.497920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-052aa62a-e018-4c0a-aaca-775e37b8e1f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:11.498671 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-052aa62a-e018-4c0a-aaca-775e37b8e1f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:11.504905 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-052aa62a-e018-4c0a-aaca-775e37b8e1f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:11.505454 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-052aa62a-e018-4c0a-aaca-775e37b8e1f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:11.507030 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-052aa62a-e018-4c0a-aaca-775e37b8e1f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:11.507507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-052aa62a-e018-4c0a-aaca-775e37b8e1f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:11.547185 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c73a046f-1102-41e5-85d3-3624b41197b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:11.554446 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c73a046f-1102-41e5-85d3-3624b41197b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.182695 Jan 28 20:30:11.555029 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 269/560] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:11 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:11.667883 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-052aa62a-e018-4c0a-aaca-775e37b8e1f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:11.675615 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-052aa62a-e018-4c0a-aaca-775e37b8e1f5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1554 microversion: 2.1 time: 0.182564 Jan 28 20:30:11.676187 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 292/561] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:11 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:12.361704 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-61ac36d2-3c53-46c9-8c83-06d93433a88f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:12.362333 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-61ac36d2-3c53-46c9-8c83-06d93433a88f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:12.368331 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-61ac36d2-3c53-46c9-8c83-06d93433a88f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:12.368849 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-61ac36d2-3c53-46c9-8c83-06d93433a88f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:12.369869 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-61ac36d2-3c53-46c9-8c83-06d93433a88f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:12.370319 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-61ac36d2-3c53-46c9-8c83-06d93433a88f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:12.501287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-61ac36d2-3c53-46c9-8c83-06d93433a88f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:12.508470 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-61ac36d2-3c53-46c9-8c83-06d93433a88f tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.150338 Jan 28 20:30:12.509022 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 270/562] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:12 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:12.576836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2f3b0ccb-dc80-4bcd-b5e4-9b0867007320 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:12.577366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2f3b0ccb-dc80-4bcd-b5e4-9b0867007320 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:12.583602 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2f3b0ccb-dc80-4bcd-b5e4-9b0867007320 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:12.584058 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2f3b0ccb-dc80-4bcd-b5e4-9b0867007320 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:12.584795 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2f3b0ccb-dc80-4bcd-b5e4-9b0867007320 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:12.585216 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2f3b0ccb-dc80-4bcd-b5e4-9b0867007320 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:12.692455 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9d9b5dcf-3882-4cca-b136-63c1eb6cd953 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:12.693054 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9d9b5dcf-3882-4cca-b136-63c1eb6cd953 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:12.699415 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9d9b5dcf-3882-4cca-b136-63c1eb6cd953 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:12.699862 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9d9b5dcf-3882-4cca-b136-63c1eb6cd953 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:12.700629 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9d9b5dcf-3882-4cca-b136-63c1eb6cd953 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:12.701055 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9d9b5dcf-3882-4cca-b136-63c1eb6cd953 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:12.715822 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2f3b0ccb-dc80-4bcd-b5e4-9b0867007320 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:12.723214 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2f3b0ccb-dc80-4bcd-b5e4-9b0867007320 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.150605 Jan 28 20:30:12.723778 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 293/563] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:12 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:12.829837 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9d9b5dcf-3882-4cca-b136-63c1eb6cd953 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:12.837525 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9d9b5dcf-3882-4cca-b136-63c1eb6cd953 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1554 microversion: 2.1 time: 0.148749 Jan 28 20:30:12.838163 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 271/564] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:12 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:13.525297 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8c2fcd95-40a5-426f-9174-ebc4b39aefaa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:13.526442 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8c2fcd95-40a5-426f-9174-ebc4b39aefaa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:13.532949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c2fcd95-40a5-426f-9174-ebc4b39aefaa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:13.533387 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c2fcd95-40a5-426f-9174-ebc4b39aefaa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:13.534404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c2fcd95-40a5-426f-9174-ebc4b39aefaa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:13.534983 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c2fcd95-40a5-426f-9174-ebc4b39aefaa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:13.674150 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8c2fcd95-40a5-426f-9174-ebc4b39aefaa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:13.681266 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8c2fcd95-40a5-426f-9174-ebc4b39aefaa tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.159639 Jan 28 20:30:13.682420 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 294/565] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:13 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:13.740002 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-02b8f939-7ec6-404e-bc7a-d25dfed14787 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:13.740598 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-02b8f939-7ec6-404e-bc7a-d25dfed14787 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:13.747657 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-02b8f939-7ec6-404e-bc7a-d25dfed14787 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:13.748101 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-02b8f939-7ec6-404e-bc7a-d25dfed14787 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:13.748957 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-02b8f939-7ec6-404e-bc7a-d25dfed14787 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:13.749379 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-02b8f939-7ec6-404e-bc7a-d25dfed14787 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:13.855076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1c0a0c97-c14a-4658-8bb2-035bed53ee62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:13.855824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1c0a0c97-c14a-4658-8bb2-035bed53ee62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:13.861866 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1c0a0c97-c14a-4658-8bb2-035bed53ee62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:13.862330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1c0a0c97-c14a-4658-8bb2-035bed53ee62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:13.863117 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1c0a0c97-c14a-4658-8bb2-035bed53ee62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:13.863542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1c0a0c97-c14a-4658-8bb2-035bed53ee62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:13.893034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-02b8f939-7ec6-404e-bc7a-d25dfed14787 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:13.900213 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-02b8f939-7ec6-404e-bc7a-d25dfed14787 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.163855 Jan 28 20:30:13.901026 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 272/566] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:13 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:14.007933 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1c0a0c97-c14a-4658-8bb2-035bed53ee62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:14.015698 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1c0a0c97-c14a-4658-8bb2-035bed53ee62 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1554 microversion: 2.1 time: 0.165046 Jan 28 20:30:14.016279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 295/567] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:13 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:14.699668 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-72280cdd-7bf7-430f-999a-e4a5961338d4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:14.700276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-72280cdd-7bf7-430f-999a-e4a5961338d4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:14.706984 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72280cdd-7bf7-430f-999a-e4a5961338d4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:14.707261 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72280cdd-7bf7-430f-999a-e4a5961338d4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:14.716453 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72280cdd-7bf7-430f-999a-e4a5961338d4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:14.716453 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72280cdd-7bf7-430f-999a-e4a5961338d4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:14.849907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-72280cdd-7bf7-430f-999a-e4a5961338d4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:14.866587 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-72280cdd-7bf7-430f-999a-e4a5961338d4 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1318 microversion: 2.1 time: 0.171609 Jan 28 20:30:14.867198 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 273/568] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:14 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:14.917598 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ddb6c517-a1dc-47bf-ac19-05c7aef9871f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:14.919598 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ddb6c517-a1dc-47bf-ac19-05c7aef9871f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:14.926229 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-a1dc-47bf-ac19-05c7aef9871f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:14.926674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-a1dc-47bf-ac19-05c7aef9871f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:14.927450 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-a1dc-47bf-ac19-05c7aef9871f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:14.927879 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-a1dc-47bf-ac19-05c7aef9871f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:15.032573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7e136feb-e7f1-4a96-9449-d377633914ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:15.033182 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7e136feb-e7f1-4a96-9449-d377633914ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:15.039072 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e136feb-e7f1-4a96-9449-d377633914ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:15.039513 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e136feb-e7f1-4a96-9449-d377633914ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:15.040325 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e136feb-e7f1-4a96-9449-d377633914ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:15.041762 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e136feb-e7f1-4a96-9449-d377633914ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:15.065734 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ddb6c517-a1dc-47bf-ac19-05c7aef9871f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:15.072973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ddb6c517-a1dc-47bf-ac19-05c7aef9871f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.160244 Jan 28 20:30:15.073542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 296/569] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:14 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:15.170265 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7e136feb-e7f1-4a96-9449-d377633914ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:15.177994 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7e136feb-e7f1-4a96-9449-d377633914ec tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1560 microversion: 2.1 time: 0.149091 Jan 28 20:30:15.178565 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 274/570] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:15 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:15.248446 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-65ae7fa1-d1e8-4cd6-92bd-2d845d828a91 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:15.248940 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-65ae7fa1-d1e8-4cd6-92bd-2d845d828a91 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:15.254649 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-65ae7fa1-d1e8-4cd6-92bd-2d845d828a91 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:15.255092 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-65ae7fa1-d1e8-4cd6-92bd-2d845d828a91 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:15.255857 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-65ae7fa1-d1e8-4cd6-92bd-2d845d828a91 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:15.256283 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-65ae7fa1-d1e8-4cd6-92bd-2d845d828a91 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:15.330481 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-65ae7fa1-d1e8-4cd6-92bd-2d845d828a91 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lazy-loading 'services' on Instance uuid 0d03f1de-078d-4fff-aec4-7c91aaaa1eed {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:30:15.398658 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-65ae7fa1-d1e8-4cd6-92bd-2d845d828a91 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments/a18c9ce5-6038-4ab1-bcff-959b959dd1b5" status: 202 len: 0 microversion: 2.1 time: 0.153781 Jan 28 20:30:15.399478 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 297/571] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:30:15 2022] DELETE /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments/a18c9ce5-6038-4ab1-bcff-959b959dd1b5 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:30:15.408416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-911b98b8-4874-4f9b-8887-0d02d0afcb7f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:15.409573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-911b98b8-4874-4f9b-8887-0d02d0afcb7f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:15.419134 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-911b98b8-4874-4f9b-8887-0d02d0afcb7f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:15.419622 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-911b98b8-4874-4f9b-8887-0d02d0afcb7f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:15.420569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-911b98b8-4874-4f9b-8887-0d02d0afcb7f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:15.421107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-911b98b8-4874-4f9b-8887-0d02d0afcb7f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:15.455398 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-911b98b8-4874-4f9b-8887-0d02d0afcb7f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050778 Jan 28 20:30:15.456537 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 275/572] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:15 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:15.629448 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-0eb7ac97-ba9a-4c81-acaa-8b978d97798b req-ce40ee11-110d-4039-9c2f-f0979316103e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3427e95-2a32-4161-ad46-076cf02f603d", "name": "network-vif-plugged", "status": "completed", "tag": "c5693d83-b5f3-413b-a2a5-d05a5cb7e05a"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:15.631028 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:15.631028 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:30:15.638403 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-0eb7ac97-ba9a-4c81-acaa-8b978d97798b req-ce40ee11-110d-4039-9c2f-f0979316103e service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:15.638844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-0eb7ac97-ba9a-4c81-acaa-8b978d97798b req-ce40ee11-110d-4039-9c2f-f0979316103e service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:15.649811 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-0eb7ac97-ba9a-4c81-acaa-8b978d97798b req-ce40ee11-110d-4039-9c2f-f0979316103e service nova] Creating event network-vif-plugged:c5693d83-b5f3-413b-a2a5-d05a5cb7e05a for instance e3427e95-2a32-4161-ad46-076cf02f603d on hv-cinder-82635 Jan 28 20:30:15.655936 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-0eb7ac97-ba9a-4c81-acaa-8b978d97798b req-ce40ee11-110d-4039-9c2f-f0979316103e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030613 Jan 28 20:30:15.656529 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 298/573] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:15.883460 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e38c164d-0849-4a39-9ea2-4b2eb862d107 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:15.884242 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e38c164d-0849-4a39-9ea2-4b2eb862d107 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:15.891210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e38c164d-0849-4a39-9ea2-4b2eb862d107 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:15.892018 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e38c164d-0849-4a39-9ea2-4b2eb862d107 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:15.893017 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e38c164d-0849-4a39-9ea2-4b2eb862d107 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:15.893500 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e38c164d-0849-4a39-9ea2-4b2eb862d107 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:16.042068 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e38c164d-0849-4a39-9ea2-4b2eb862d107 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:16.049619 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e38c164d-0849-4a39-9ea2-4b2eb862d107 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1509 microversion: 2.1 time: 0.169705 Jan 28 20:30:16.050370 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 276/574] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:15 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:16.090596 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d11fe393-eb00-413f-8ff7-4e7b1a7b452f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:16.091358 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d11fe393-eb00-413f-8ff7-4e7b1a7b452f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:16.097630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d11fe393-eb00-413f-8ff7-4e7b1a7b452f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:16.098119 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d11fe393-eb00-413f-8ff7-4e7b1a7b452f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:16.098898 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d11fe393-eb00-413f-8ff7-4e7b1a7b452f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:16.099329 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d11fe393-eb00-413f-8ff7-4e7b1a7b452f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:16.242053 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d11fe393-eb00-413f-8ff7-4e7b1a7b452f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:16.250360 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d11fe393-eb00-413f-8ff7-4e7b1a7b452f tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.164414 Jan 28 20:30:16.251846 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 299/575] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:16 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:16.467981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-aef7dbcc-3630-470c-aece-ac55568159d1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:16.468935 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-aef7dbcc-3630-470c-aece-ac55568159d1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:16.474625 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aef7dbcc-3630-470c-aece-ac55568159d1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:16.475086 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aef7dbcc-3630-470c-aece-ac55568159d1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:16.475862 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aef7dbcc-3630-470c-aece-ac55568159d1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:16.476298 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aef7dbcc-3630-470c-aece-ac55568159d1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:16.504236 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-aef7dbcc-3630-470c-aece-ac55568159d1 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040073 Jan 28 20:30:16.504824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 277/576] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:16 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:17.267256 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4f958130-196e-4fd1-bb46-6c0c17194e92 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:17.267863 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4f958130-196e-4fd1-bb46-6c0c17194e92 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:17.274219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4f958130-196e-4fd1-bb46-6c0c17194e92 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:17.274750 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4f958130-196e-4fd1-bb46-6c0c17194e92 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:17.276087 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4f958130-196e-4fd1-bb46-6c0c17194e92 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:17.276513 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4f958130-196e-4fd1-bb46-6c0c17194e92 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:17.411677 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4f958130-196e-4fd1-bb46-6c0c17194e92 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:17.419176 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4f958130-196e-4fd1-bb46-6c0c17194e92 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.155628 Jan 28 20:30:17.419982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 300/577] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:17 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:17.515867 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4fba280f-23d9-4082-b6f8-6be222881230 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:17.516811 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4fba280f-23d9-4082-b6f8-6be222881230 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:17.523110 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4fba280f-23d9-4082-b6f8-6be222881230 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:17.523502 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4fba280f-23d9-4082-b6f8-6be222881230 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:17.524282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4fba280f-23d9-4082-b6f8-6be222881230 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:17.524714 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4fba280f-23d9-4082-b6f8-6be222881230 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:17.553705 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4fba280f-23d9-4082-b6f8-6be222881230 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042016 Jan 28 20:30:17.554303 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 278/578] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:17 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:18.436754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-50c7ddcb-a2ec-4795-8828-9eb2892175ec tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:18.437455 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-50c7ddcb-a2ec-4795-8828-9eb2892175ec tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:18.443740 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-50c7ddcb-a2ec-4795-8828-9eb2892175ec tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:18.444183 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-50c7ddcb-a2ec-4795-8828-9eb2892175ec tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:18.444954 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-50c7ddcb-a2ec-4795-8828-9eb2892175ec tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:18.445376 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-50c7ddcb-a2ec-4795-8828-9eb2892175ec tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:18.566210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-72605681-142a-4526-9e20-941aceb00726 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:18.567465 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-72605681-142a-4526-9e20-941aceb00726 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:18.574702 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72605681-142a-4526-9e20-941aceb00726 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:18.575145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72605681-142a-4526-9e20-941aceb00726 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:18.576545 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72605681-142a-4526-9e20-941aceb00726 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:18.578724 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72605681-142a-4526-9e20-941aceb00726 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:18.585426 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-50c7ddcb-a2ec-4795-8828-9eb2892175ec tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:18.593498 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-50c7ddcb-a2ec-4795-8828-9eb2892175ec tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.160722 Jan 28 20:30:18.594432 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 301/579] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:18 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:18.608793 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-72605681-142a-4526-9e20-941aceb00726 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047672 Jan 28 20:30:18.609369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 279/580] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:18 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:19.609844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a1ba1077-9b7b-487d-bcd7-320939e9cd8c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:19.610486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a1ba1077-9b7b-487d-bcd7-320939e9cd8c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:19.617385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a1ba1077-9b7b-487d-bcd7-320939e9cd8c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:19.618006 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a1ba1077-9b7b-487d-bcd7-320939e9cd8c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:19.619635 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a1ba1077-9b7b-487d-bcd7-320939e9cd8c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:19.620071 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a1ba1077-9b7b-487d-bcd7-320939e9cd8c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:19.621196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-216c4825-729a-4fbc-a661-862dbccf0f66 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:19.622169 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-216c4825-729a-4fbc-a661-862dbccf0f66 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:19.628234 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-216c4825-729a-4fbc-a661-862dbccf0f66 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:19.628678 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-216c4825-729a-4fbc-a661-862dbccf0f66 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:19.629454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-216c4825-729a-4fbc-a661-862dbccf0f66 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:19.629905 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-216c4825-729a-4fbc-a661-862dbccf0f66 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:19.659078 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-216c4825-729a-4fbc-a661-862dbccf0f66 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Jan 28 20:30:19.659638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 280/581] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:19 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:19.750224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a1ba1077-9b7b-487d-bcd7-320939e9cd8c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:19.757379 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a1ba1077-9b7b-487d-bcd7-320939e9cd8c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.151206 Jan 28 20:30:19.757978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 302/582] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:19 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:20.670411 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8ae0614a-a2aa-4ad4-b675-286c4516305f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:20.671312 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8ae0614a-a2aa-4ad4-b675-286c4516305f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:20.677386 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ae0614a-a2aa-4ad4-b675-286c4516305f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:20.677832 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ae0614a-a2aa-4ad4-b675-286c4516305f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:20.678627 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ae0614a-a2aa-4ad4-b675-286c4516305f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:20.679056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ae0614a-a2aa-4ad4-b675-286c4516305f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:20.707307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8ae0614a-a2aa-4ad4-b675-286c4516305f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040620 Jan 28 20:30:20.707783 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 281/583] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:20 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:20.772765 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-eac0eb50-134b-4593-9119-7a3bca947bd7 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:20.773360 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-eac0eb50-134b-4593-9119-7a3bca947bd7 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:20.779981 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eac0eb50-134b-4593-9119-7a3bca947bd7 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:20.780425 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eac0eb50-134b-4593-9119-7a3bca947bd7 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:20.781205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eac0eb50-134b-4593-9119-7a3bca947bd7 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:20.781633 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eac0eb50-134b-4593-9119-7a3bca947bd7 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:20.914329 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-eac0eb50-134b-4593-9119-7a3bca947bd7 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:20.921519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-eac0eb50-134b-4593-9119-7a3bca947bd7 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.152325 Jan 28 20:30:20.922112 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 303/584] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:20 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:21.718495 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dbbe1e82-fe1a-4a46-ab25-016ec36e0687 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:21.719411 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dbbe1e82-fe1a-4a46-ab25-016ec36e0687 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:21.725624 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dbbe1e82-fe1a-4a46-ab25-016ec36e0687 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:21.726104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dbbe1e82-fe1a-4a46-ab25-016ec36e0687 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:21.726886 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dbbe1e82-fe1a-4a46-ab25-016ec36e0687 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:21.727318 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dbbe1e82-fe1a-4a46-ab25-016ec36e0687 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:21.755604 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dbbe1e82-fe1a-4a46-ab25-016ec36e0687 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040846 Jan 28 20:30:21.756151 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 282/585] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:21 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:21.937864 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3519524e-876a-465e-9bb9-fa523e5655b2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:21.938503 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3519524e-876a-465e-9bb9-fa523e5655b2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:21.944837 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3519524e-876a-465e-9bb9-fa523e5655b2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:21.945264 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3519524e-876a-465e-9bb9-fa523e5655b2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:21.946066 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3519524e-876a-465e-9bb9-fa523e5655b2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:21.946495 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3519524e-876a-465e-9bb9-fa523e5655b2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:22.083468 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3519524e-876a-465e-9bb9-fa523e5655b2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:22.090754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3519524e-876a-465e-9bb9-fa523e5655b2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.156584 Jan 28 20:30:22.091322 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 304/586] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:21 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:22.768034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-339b4b50-e98b-4628-aa59-19ed3c7a6755 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:22.768996 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-339b4b50-e98b-4628-aa59-19ed3c7a6755 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:22.775123 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-339b4b50-e98b-4628-aa59-19ed3c7a6755 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:22.775571 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-339b4b50-e98b-4628-aa59-19ed3c7a6755 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:22.776350 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-339b4b50-e98b-4628-aa59-19ed3c7a6755 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:22.777097 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-339b4b50-e98b-4628-aa59-19ed3c7a6755 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:22.805672 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-339b4b50-e98b-4628-aa59-19ed3c7a6755 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041247 Jan 28 20:30:22.806182 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 283/587] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:22 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:23.107032 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ecb8d03f-3720-4a62-8ee9-db446f284742 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:23.107632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ecb8d03f-3720-4a62-8ee9-db446f284742 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:23.113540 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03f-3720-4a62-8ee9-db446f284742 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:23.114001 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03f-3720-4a62-8ee9-db446f284742 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:23.114773 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03f-3720-4a62-8ee9-db446f284742 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:23.115191 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03f-3720-4a62-8ee9-db446f284742 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:23.246106 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ecb8d03f-3720-4a62-8ee9-db446f284742 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:23.253148 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ecb8d03f-3720-4a62-8ee9-db446f284742 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.149721 Jan 28 20:30:23.253704 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 305/588] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:23 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:23.816408 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d3deeee2-cde9-4f5b-ba89-374670281ed5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:23.817308 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d3deeee2-cde9-4f5b-ba89-374670281ed5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:23.823555 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3deeee2-cde9-4f5b-ba89-374670281ed5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:23.823977 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3deeee2-cde9-4f5b-ba89-374670281ed5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:23.824750 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3deeee2-cde9-4f5b-ba89-374670281ed5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:23.825178 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3deeee2-cde9-4f5b-ba89-374670281ed5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:23.854409 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d3deeee2-cde9-4f5b-ba89-374670281ed5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041511 Jan 28 20:30:23.857907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 284/589] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:23 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:24.270573 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bf626cc0-5ff0-4213-8b2c-7f85a0b278d6 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:24.271225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bf626cc0-5ff0-4213-8b2c-7f85a0b278d6 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:24.278343 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bf626cc0-5ff0-4213-8b2c-7f85a0b278d6 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:24.278778 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bf626cc0-5ff0-4213-8b2c-7f85a0b278d6 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:24.279640 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bf626cc0-5ff0-4213-8b2c-7f85a0b278d6 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:24.280078 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bf626cc0-5ff0-4213-8b2c-7f85a0b278d6 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:24.416883 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bf626cc0-5ff0-4213-8b2c-7f85a0b278d6 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:24.424221 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bf626cc0-5ff0-4213-8b2c-7f85a0b278d6 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1265 microversion: 2.1 time: 0.157310 Jan 28 20:30:24.424784 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 306/590] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:24 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:24.866442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-50ee302e-fa36-48a9-a0c2-3eab24fdf38d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:24.867492 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-50ee302e-fa36-48a9-a0c2-3eab24fdf38d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:24.874609 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50ee302e-fa36-48a9-a0c2-3eab24fdf38d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:24.875108 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50ee302e-fa36-48a9-a0c2-3eab24fdf38d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:24.875918 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50ee302e-fa36-48a9-a0c2-3eab24fdf38d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:24.876357 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50ee302e-fa36-48a9-a0c2-3eab24fdf38d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:24.907190 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-50ee302e-fa36-48a9-a0c2-3eab24fdf38d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 Jan 28 20:30:24.907661 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 285/591] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:24 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:25.240926 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-695149559", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "networks": [{"uuid": "90b7b458-4b47-48b0-9af1-84b27f2d7b01"}]}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:25.289636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] validate_networks() for [('90b7b458-4b47-48b0-9af1-84b27f2d7b01', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:30:25.441358 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b5fcc903-5459-4b16-b8b9-3b98eeac2a9c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:25.441987 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b5fcc903-5459-4b16-b8b9-3b98eeac2a9c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:25.447810 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b5fcc903-5459-4b16-b8b9-3b98eeac2a9c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:25.448259 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b5fcc903-5459-4b16-b8b9-3b98eeac2a9c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:25.449080 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b5fcc903-5459-4b16-b8b9-3b98eeac2a9c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:25.449518 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b5fcc903-5459-4b16-b8b9-3b98eeac2a9c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:25.675438 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b5fcc903-5459-4b16-b8b9-3b98eeac2a9c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:25.682716 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b5fcc903-5459-4b16-b8b9-3b98eeac2a9c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1452 microversion: 2.1 time: 0.245071 Jan 28 20:30:25.684506 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 286/592] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:25 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1452 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:25.697961 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6f377f98-c9a8-4b97-8c87-2a9819e0cd64 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:25.699070 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6f377f98-c9a8-4b97-8c87-2a9819e0cd64 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:25.702772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:30:25.703330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:30:25.704039 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:30:25.704515 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:30:25.704923 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6f377f98-c9a8-4b97-8c87-2a9819e0cd64 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:25.705338 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:30:25.705460 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6f377f98-c9a8-4b97-8c87-2a9819e0cd64 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:25.706178 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6f377f98-c9a8-4b97-8c87-2a9819e0cd64 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:25.706615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6f377f98-c9a8-4b97-8c87-2a9819e0cd64 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:25.723384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:25.724036 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:25.725046 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:25.725624 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:25.742048 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Getting quotas for project 78a5e26db5b844c4b585a7441fefd731. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:30:25.745972 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Getting quotas for user 912a6a973222441788982735658fabcb and project 78a5e26db5b844c4b585a7441fefd731. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:30:25.756644 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:30:25.758993 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:30:25.805462 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f25f900e-7ae9-4c30-99e8-8c0196d5538f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569110 Jan 28 20:30:25.806150 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 307/593] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:30:25.815658 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1b410618-0acb-4655-a040-77bbf4d8a484 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:25.816369 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1b410618-0acb-4655-a040-77bbf4d8a484 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:25.881600 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1b410618-0acb-4655-a040-77bbf4d8a484 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:25.886521 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6f377f98-c9a8-4b97-8c87-2a9819e0cd64 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:25.892754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1b410618-0acb-4655-a040-77bbf4d8a484 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1218 microversion: 2.1 time: 0.080562 Jan 28 20:30:25.893515 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 308/594] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:25 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:25.894368 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6f377f98-c9a8-4b97-8c87-2a9819e0cd64 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1452 microversion: 2.1 time: 0.199760 Jan 28 20:30:25.902434 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 287/595] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:25 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1452 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:25.919907 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f2dff27f-9ae4-42a0-a671-663f5bc5f114 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:25.920978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f2dff27f-9ae4-42a0-a671-663f5bc5f114 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:25.927685 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f2dff27f-9ae4-42a0-a671-663f5bc5f114 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:25.928290 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f2dff27f-9ae4-42a0-a671-663f5bc5f114 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:25.929198 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f2dff27f-9ae4-42a0-a671-663f5bc5f114 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:25.929747 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f2dff27f-9ae4-42a0-a671-663f5bc5f114 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:25.960944 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f2dff27f-9ae4-42a0-a671-663f5bc5f114 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045297 Jan 28 20:30:25.961845 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 309/596] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:25 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:26.910249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-92dcf7f6-9c70-4754-a8f4-62d948711723 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:26.910891 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-92dcf7f6-9c70-4754-a8f4-62d948711723 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:26.917051 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-92dcf7f6-9c70-4754-a8f4-62d948711723 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:26.917536 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-92dcf7f6-9c70-4754-a8f4-62d948711723 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:26.918355 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-92dcf7f6-9c70-4754-a8f4-62d948711723 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:26.918793 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-92dcf7f6-9c70-4754-a8f4-62d948711723 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:26.979141 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f266b638-09a3-441b-b77d-0ac7d0b64f79 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:26.980183 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f266b638-09a3-441b-b77d-0ac7d0b64f79 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:26.986728 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f266b638-09a3-441b-b77d-0ac7d0b64f79 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:26.987169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f266b638-09a3-441b-b77d-0ac7d0b64f79 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:26.987956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f266b638-09a3-441b-b77d-0ac7d0b64f79 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:26.988377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f266b638-09a3-441b-b77d-0ac7d0b64f79 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:27.005089 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-92dcf7f6-9c70-4754-a8f4-62d948711723 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:27.013569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-92dcf7f6-9c70-4754-a8f4-62d948711723 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1222 microversion: 2.1 time: 0.107000 Jan 28 20:30:27.014375 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 288/597] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:26 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:27.020663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f266b638-09a3-441b-b77d-0ac7d0b64f79 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049230 Jan 28 20:30:27.021391 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 310/598] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:26 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:27.964537 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-cc553230-3cde-434a-ab66-67812f33ab8e req-23459a44-2091-4b41-9f70-51ae80fdf2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3427e95-2a32-4161-ad46-076cf02f603d", "tag": "c5693d83-b5f3-413b-a2a5-d05a5cb7e05a"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:27.967071 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:27.967071 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:30:27.974679 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-cc553230-3cde-434a-ab66-67812f33ab8e req-23459a44-2091-4b41-9f70-51ae80fdf2c6 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:27.975201 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-cc553230-3cde-434a-ab66-67812f33ab8e req-23459a44-2091-4b41-9f70-51ae80fdf2c6 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:27.985741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-cc553230-3cde-434a-ab66-67812f33ab8e req-23459a44-2091-4b41-9f70-51ae80fdf2c6 service nova] Creating event network-changed:c5693d83-b5f3-413b-a2a5-d05a5cb7e05a for instance e3427e95-2a32-4161-ad46-076cf02f603d on hv-cinder-82635 Jan 28 20:30:27.991251 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-cc553230-3cde-434a-ab66-67812f33ab8e req-23459a44-2091-4b41-9f70-51ae80fdf2c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030623 Jan 28 20:30:27.991832 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 289/599] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:28.033337 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8a091b25-d83d-45df-a277-079fa9ecad88 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:28.034608 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8a091b25-d83d-45df-a277-079fa9ecad88 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:28.035939 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cb0c8664-7376-4134-a4c5-ceb46560f3a3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:28.036699 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-cb0c8664-7376-4134-a4c5-ceb46560f3a3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:28.041028 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8a091b25-d83d-45df-a277-079fa9ecad88 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:28.041672 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8a091b25-d83d-45df-a277-079fa9ecad88 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:28.042481 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8a091b25-d83d-45df-a277-079fa9ecad88 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:28.042906 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8a091b25-d83d-45df-a277-079fa9ecad88 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:28.043413 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cb0c8664-7376-4134-a4c5-ceb46560f3a3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:28.043945 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cb0c8664-7376-4134-a4c5-ceb46560f3a3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:28.044793 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cb0c8664-7376-4134-a4c5-ceb46560f3a3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:28.045299 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cb0c8664-7376-4134-a4c5-ceb46560f3a3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:28.074773 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8a091b25-d83d-45df-a277-079fa9ecad88 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Jan 28 20:30:28.075628 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 290/600] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:28 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:30:28.106090 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cb0c8664-7376-4134-a4c5-ceb46560f3a3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:28.113677 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-cb0c8664-7376-4134-a4c5-ceb46560f3a3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1214 microversion: 2.1 time: 0.087397 Jan 28 20:30:28.117468 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 311/601] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:28 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:29.088404 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0cf0e419-f5fb-42b5-8b08-db9aae200ef6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:29.090173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0cf0e419-f5fb-42b5-8b08-db9aae200ef6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:29.096843 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0cf0e419-f5fb-42b5-8b08-db9aae200ef6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:29.097287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0cf0e419-f5fb-42b5-8b08-db9aae200ef6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:29.098100 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0cf0e419-f5fb-42b5-8b08-db9aae200ef6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:29.098529 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0cf0e419-f5fb-42b5-8b08-db9aae200ef6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:29.130412 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0cf0e419-f5fb-42b5-8b08-db9aae200ef6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046715 Jan 28 20:30:29.131147 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 291/602] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:29 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:29.131262 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2449a81e-3322-4fe1-8512-a621b749c203 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:29.131682 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2449a81e-3322-4fe1-8512-a621b749c203 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:29.138155 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2449a81e-3322-4fe1-8512-a621b749c203 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:29.138602 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2449a81e-3322-4fe1-8512-a621b749c203 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:29.139385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2449a81e-3322-4fe1-8512-a621b749c203 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:29.139818 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2449a81e-3322-4fe1-8512-a621b749c203 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:29.209259 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2449a81e-3322-4fe1-8512-a621b749c203 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:29.217593 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2449a81e-3322-4fe1-8512-a621b749c203 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1214 microversion: 2.1 time: 0.090048 Jan 28 20:30:29.218209 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 312/603] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:29 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:30.142369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b4901c1e-6499-4d7a-8d20-5dd31464ed1c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:30.143204 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b4901c1e-6499-4d7a-8d20-5dd31464ed1c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:30.149370 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4901c1e-6499-4d7a-8d20-5dd31464ed1c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:30.149819 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4901c1e-6499-4d7a-8d20-5dd31464ed1c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:30.150637 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4901c1e-6499-4d7a-8d20-5dd31464ed1c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:30.151110 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4901c1e-6499-4d7a-8d20-5dd31464ed1c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:30.179974 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b4901c1e-6499-4d7a-8d20-5dd31464ed1c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041374 Jan 28 20:30:30.180526 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 292/604] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:30 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:30.234329 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-870540f8-c8b5-41bc-a0ae-d314d47c1986 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:30.235161 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-870540f8-c8b5-41bc-a0ae-d314d47c1986 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:30.241596 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-870540f8-c8b5-41bc-a0ae-d314d47c1986 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:30.242067 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-870540f8-c8b5-41bc-a0ae-d314d47c1986 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:30.242833 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-870540f8-c8b5-41bc-a0ae-d314d47c1986 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:30.243263 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-870540f8-c8b5-41bc-a0ae-d314d47c1986 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:30.314979 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-870540f8-c8b5-41bc-a0ae-d314d47c1986 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:30.321974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-870540f8-c8b5-41bc-a0ae-d314d47c1986 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1276 microversion: 2.1 time: 0.091394 Jan 28 20:30:30.322538 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 313/605] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:30 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:31.191279 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-41b439de-3a31-4fbb-ab26-c6459aa93388 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:31.192190 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-41b439de-3a31-4fbb-ab26-c6459aa93388 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:31.198882 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41b439de-3a31-4fbb-ab26-c6459aa93388 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:31.199338 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41b439de-3a31-4fbb-ab26-c6459aa93388 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:31.200722 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41b439de-3a31-4fbb-ab26-c6459aa93388 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:31.201223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41b439de-3a31-4fbb-ab26-c6459aa93388 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:31.233071 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-41b439de-3a31-4fbb-ab26-c6459aa93388 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045422 Jan 28 20:30:31.233656 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 293/606] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:31 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 20:30:31.340809 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3ee14805-7e8a-4ab2-9926-8084f7a989d3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:31.341579 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3ee14805-7e8a-4ab2-9926-8084f7a989d3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:31.353040 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ee14805-7e8a-4ab2-9926-8084f7a989d3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:31.354256 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ee14805-7e8a-4ab2-9926-8084f7a989d3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:31.356469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ee14805-7e8a-4ab2-9926-8084f7a989d3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:31.357755 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3ee14805-7e8a-4ab2-9926-8084f7a989d3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:31.527557 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3ee14805-7e8a-4ab2-9926-8084f7a989d3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:31.538176 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3ee14805-7e8a-4ab2-9926-8084f7a989d3 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1318 microversion: 2.1 time: 0.197947 Jan 28 20:30:31.538176 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 314/607] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:31 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:31.591414 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-311e1cc7-ad41-4f0d-afba-f09d46d9f5d9 req-6b983f3b-692d-4e61-b18e-3aafe0024ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "363cf95b-1c28-42b0-8246-4cbff39ae4a8", "tag": "5659c60c-97c6-4ce9-98c3-e9ec7e3a47df"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:31.593171 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:31.593171 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:30:31.600557 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-311e1cc7-ad41-4f0d-afba-f09d46d9f5d9 req-6b983f3b-692d-4e61-b18e-3aafe0024ddd service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:31.601007 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-311e1cc7-ad41-4f0d-afba-f09d46d9f5d9 req-6b983f3b-692d-4e61-b18e-3aafe0024ddd service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:31.612133 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-311e1cc7-ad41-4f0d-afba-f09d46d9f5d9 req-6b983f3b-692d-4e61-b18e-3aafe0024ddd service nova] Creating event network-changed:5659c60c-97c6-4ce9-98c3-e9ec7e3a47df for instance 363cf95b-1c28-42b0-8246-4cbff39ae4a8 on hv-cinder-82635 Jan 28 20:30:31.617548 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-311e1cc7-ad41-4f0d-afba-f09d46d9f5d9 req-6b983f3b-692d-4e61-b18e-3aafe0024ddd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030534 Jan 28 20:30:31.618426 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 294/608] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:32.041254 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-545c21bc-0a57-4455-bc85-97284107cb93 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2470b404-caae-44a0-b47b-49690d6b38e6"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:32.042342 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-545c21bc-0a57-4455-bc85-97284107cb93 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:32.048194 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-545c21bc-0a57-4455-bc85-97284107cb93 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:32.048632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-545c21bc-0a57-4455-bc85-97284107cb93 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:32.049401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-545c21bc-0a57-4455-bc85-97284107cb93 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:32.049825 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-545c21bc-0a57-4455-bc85-97284107cb93 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:32.317498 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-545c21bc-0a57-4455-bc85-97284107cb93 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "POST /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276161 Jan 28 20:30:32.318914 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 315/609] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:30:32 2022] POST /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:32.552059 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-216c3d2d-d7e1-49a6-9736-55b9c4f4bbc2 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:32.553243 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-216c3d2d-d7e1-49a6-9736-55b9c4f4bbc2 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:32.562601 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-216c3d2d-d7e1-49a6-9736-55b9c4f4bbc2 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:32.563183 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-216c3d2d-d7e1-49a6-9736-55b9c4f4bbc2 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:32.564146 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-216c3d2d-d7e1-49a6-9736-55b9c4f4bbc2 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:32.564932 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-216c3d2d-d7e1-49a6-9736-55b9c4f4bbc2 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:32.732645 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-216c3d2d-d7e1-49a6-9736-55b9c4f4bbc2 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:32.742333 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-216c3d2d-d7e1-49a6-9736-55b9c4f4bbc2 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1318 microversion: 2.1 time: 0.194087 Jan 28 20:30:32.743214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 295/610] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:32 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:33.611007 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-81c6491d-3c76-4374-b691-daca37d05da7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:33.611609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-81c6491d-3c76-4374-b691-daca37d05da7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:33.618697 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-81c6491d-3c76-4374-b691-daca37d05da7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:33.619141 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-81c6491d-3c76-4374-b691-daca37d05da7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:33.619927 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-81c6491d-3c76-4374-b691-daca37d05da7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:33.620855 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-81c6491d-3c76-4374-b691-daca37d05da7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:33.646052 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-81c6491d-3c76-4374-b691-daca37d05da7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:30:33.723480 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-81c6491d-3c76-4374-b691-daca37d05da7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 204 len: 0 microversion: 2.1 time: 0.116136 Jan 28 20:30:33.724201 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 316/611] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:30:33 2022] DELETE /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:30:33.734064 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-70b5c5f1-f0eb-4aa2-9b44-7c663f49e8d5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:33.734781 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-70b5c5f1-f0eb-4aa2-9b44-7c663f49e8d5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:33.742276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-70b5c5f1-f0eb-4aa2-9b44-7c663f49e8d5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:33.742805 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-70b5c5f1-f0eb-4aa2-9b44-7c663f49e8d5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:33.743654 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-70b5c5f1-f0eb-4aa2-9b44-7c663f49e8d5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:33.744154 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-70b5c5f1-f0eb-4aa2-9b44-7c663f49e8d5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:33.760110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9dfb5151-92b7-41ea-bd83-17629955a10a tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:33.761608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9dfb5151-92b7-41ea-bd83-17629955a10a tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:33.768624 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9dfb5151-92b7-41ea-bd83-17629955a10a tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:33.769191 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9dfb5151-92b7-41ea-bd83-17629955a10a tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:33.770179 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9dfb5151-92b7-41ea-bd83-17629955a10a tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:33.770601 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9dfb5151-92b7-41ea-bd83-17629955a10a tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:33.978819 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-70b5c5f1-f0eb-4aa2-9b44-7c663f49e8d5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:33.987466 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-70b5c5f1-f0eb-4aa2-9b44-7c663f49e8d5 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1506 microversion: 2.1 time: 0.258785 Jan 28 20:30:33.988599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 296/612] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:33 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:33.992571 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9dfb5151-92b7-41ea-bd83-17629955a10a tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:34.000766 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9dfb5151-92b7-41ea-bd83-17629955a10a tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1318 microversion: 2.1 time: 0.244730 Jan 28 20:30:34.001352 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 317/613] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:33 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:35.005000 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-42ee2f0c-09d7-4c39-8bf8-887090fd5f6a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:35.005599 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-42ee2f0c-09d7-4c39-8bf8-887090fd5f6a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:35.022439 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bcb5c397-bef0-4a4a-bdfd-0b01185706f5 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:35.023066 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bcb5c397-bef0-4a4a-bdfd-0b01185706f5 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:35.042815 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-42ee2f0c-09d7-4c39-8bf8-887090fd5f6a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:35.043321 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-42ee2f0c-09d7-4c39-8bf8-887090fd5f6a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:35.047067 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-42ee2f0c-09d7-4c39-8bf8-887090fd5f6a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:35.055944 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bcb5c397-bef0-4a4a-bdfd-0b01185706f5 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:35.055944 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bcb5c397-bef0-4a4a-bdfd-0b01185706f5 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:35.056312 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-42ee2f0c-09d7-4c39-8bf8-887090fd5f6a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:35.056402 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bcb5c397-bef0-4a4a-bdfd-0b01185706f5 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:35.056402 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bcb5c397-bef0-4a4a-bdfd-0b01185706f5 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:35.264225 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-42ee2f0c-09d7-4c39-8bf8-887090fd5f6a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:35.271791 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-42ee2f0c-09d7-4c39-8bf8-887090fd5f6a tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1506 microversion: 2.1 time: 0.270440 Jan 28 20:30:35.272087 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bcb5c397-bef0-4a4a-bdfd-0b01185706f5 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:35.274277 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 297/614] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:35 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:35.282815 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bcb5c397-bef0-4a4a-bdfd-0b01185706f5 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1318 microversion: 2.1 time: 0.268879 Jan 28 20:30:35.285642 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 318/615] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:35 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:36.289198 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f86119bb-254d-4c69-8e13-d984b0e7e15d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:36.290461 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f86119bb-254d-4c69-8e13-d984b0e7e15d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:36.302994 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-fb2b3887-fee1-4d6e-95ad-b9bde8b1d63f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:36.304158 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-fb2b3887-fee1-4d6e-95ad-b9bde8b1d63f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:36.314408 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f86119bb-254d-4c69-8e13-d984b0e7e15d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:36.316736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f86119bb-254d-4c69-8e13-d984b0e7e15d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:36.320280 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f86119bb-254d-4c69-8e13-d984b0e7e15d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:36.320603 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fb2b3887-fee1-4d6e-95ad-b9bde8b1d63f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:36.321061 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fb2b3887-fee1-4d6e-95ad-b9bde8b1d63f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:36.321856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fb2b3887-fee1-4d6e-95ad-b9bde8b1d63f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:36.322336 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fb2b3887-fee1-4d6e-95ad-b9bde8b1d63f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:36.325475 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f86119bb-254d-4c69-8e13-d984b0e7e15d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:36.622205 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f86119bb-254d-4c69-8e13-d984b0e7e15d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:36.630690 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f86119bb-254d-4c69-8e13-d984b0e7e15d tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1506 microversion: 2.1 time: 0.345941 Jan 28 20:30:36.631738 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 298/616] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:36 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:36.645849 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-fb2b3887-fee1-4d6e-95ad-b9bde8b1d63f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:36.654170 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-fb2b3887-fee1-4d6e-95ad-b9bde8b1d63f tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1318 microversion: 2.1 time: 0.355434 Jan 28 20:30:36.654751 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 319/617] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:36 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:37.649410 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-06142463-618a-4453-abbb-02abcf2465e6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:37.650151 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-06142463-618a-4453-abbb-02abcf2465e6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:37.658279 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06142463-618a-4453-abbb-02abcf2465e6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:37.659163 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06142463-618a-4453-abbb-02abcf2465e6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:37.660340 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06142463-618a-4453-abbb-02abcf2465e6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:37.660992 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-06142463-618a-4453-abbb-02abcf2465e6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:37.674156 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-57420bd1-7e53-43e1-aa57-451783c6e570 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:37.675416 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-57420bd1-7e53-43e1-aa57-451783c6e570 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:37.690531 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-57420bd1-7e53-43e1-aa57-451783c6e570 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:37.694225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-57420bd1-7e53-43e1-aa57-451783c6e570 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:37.695150 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-57420bd1-7e53-43e1-aa57-451783c6e570 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:37.695687 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-57420bd1-7e53-43e1-aa57-451783c6e570 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:37.786537 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-06142463-618a-4453-abbb-02abcf2465e6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:37.804363 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-06142463-618a-4453-abbb-02abcf2465e6 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 200 len: 1464 microversion: 2.1 time: 0.160235 Jan 28 20:30:37.806953 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 299/618] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:37 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:37.815381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-93a26e85-95d4-4f95-8f8f-a3a5e117de00 req-2f680a0f-b32e-4dc3-9647-96c7f8b77d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f87e725-240c-4b00-836b-4e5e8a4f0916", "name": "network-vif-deleted", "tag": "54934fcd-603d-4abb-9727-1c1d86acb034"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:37.817522 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:37.817522 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:30:37.826152 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-93a26e85-95d4-4f95-8f8f-a3a5e117de00 req-2f680a0f-b32e-4dc3-9647-96c7f8b77d9d service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:37.826605 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-93a26e85-95d4-4f95-8f8f-a3a5e117de00 req-2f680a0f-b32e-4dc3-9647-96c7f8b77d9d service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:37.839424 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-93a26e85-95d4-4f95-8f8f-a3a5e117de00 req-2f680a0f-b32e-4dc3-9647-96c7f8b77d9d service nova] Creating event network-vif-deleted:54934fcd-603d-4abb-9727-1c1d86acb034 for instance 9f87e725-240c-4b00-836b-4e5e8a4f0916 on hv-cinder-82635 Jan 28 20:30:37.844598 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-93a26e85-95d4-4f95-8f8f-a3a5e117de00 req-2f680a0f-b32e-4dc3-9647-96c7f8b77d9d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035758 Jan 28 20:30:37.845320 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 300/619] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:37.933069 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-57420bd1-7e53-43e1-aa57-451783c6e570 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:37.942012 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-57420bd1-7e53-43e1-aa57-451783c6e570 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1318 microversion: 2.1 time: 0.273553 Jan 28 20:30:37.942621 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 320/620] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:37 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:38.824346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ab104568-4f2f-44e2-87de-6bfc67840c43 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:38.825025 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ab104568-4f2f-44e2-87de-6bfc67840c43 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 9f87e725-240c-4b00-836b-4e5e8a4f0916] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:38.831610 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab104568-4f2f-44e2-87de-6bfc67840c43 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:38.832049 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab104568-4f2f-44e2-87de-6bfc67840c43 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:38.832821 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab104568-4f2f-44e2-87de-6bfc67840c43 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:38.833246 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab104568-4f2f-44e2-87de-6bfc67840c43 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:38.846891 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-ab104568-4f2f-44e2-87de-6bfc67840c43 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] HTTP exception thrown: Instance 9f87e725-240c-4b00-836b-4e5e8a4f0916 could not be found. Jan 28 20:30:38.847473 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ab104568-4f2f-44e2-87de-6bfc67840c43 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Returning 404 to user: Instance 9f87e725-240c-4b00-836b-4e5e8a4f0916 could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:30:38.848289 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ab104568-4f2f-44e2-87de-6bfc67840c43 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916" status: 404 len: 111 microversion: 2.1 time: 0.028525 Jan 28 20:30:38.849001 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 301/621] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:38 2022] GET /compute/v2.1/servers/9f87e725-240c-4b00-836b-4e5e8a4f0916 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:30:38.857109 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bce5ed01-82c4-48c0-b931-3545ac2e4a4b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:38.858208 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bce5ed01-82c4-48c0-b931-3545ac2e4a4b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:38.864468 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bce5ed01-82c4-48c0-b931-3545ac2e4a4b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:38.865004 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bce5ed01-82c4-48c0-b931-3545ac2e4a4b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:38.865781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bce5ed01-82c4-48c0-b931-3545ac2e4a4b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:38.866239 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bce5ed01-82c4-48c0-b931-3545ac2e4a4b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:38.891935 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bce5ed01-82c4-48c0-b931-3545ac2e4a4b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:30:38.966673 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b138a10c-041a-44d9-bec8-62e9389edf0e tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:38.967334 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b138a10c-041a-44d9-bec8-62e9389edf0e tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:38.980004 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bce5ed01-82c4-48c0-b931-3545ac2e4a4b tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 204 len: 0 microversion: 2.1 time: 0.123440 Jan 28 20:30:38.981953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 321/622] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:30:38 2022] DELETE /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:30:38.982726 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b138a10c-041a-44d9-bec8-62e9389edf0e tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:38.984578 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b138a10c-041a-44d9-bec8-62e9389edf0e tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:38.986398 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b138a10c-041a-44d9-bec8-62e9389edf0e tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:38.987497 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b138a10c-041a-44d9-bec8-62e9389edf0e tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:38.994193 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-77d751a3-37e0-40b1-adad-4ab79e36fc2f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:38.994999 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-77d751a3-37e0-40b1-adad-4ab79e36fc2f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:39.001715 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-77d751a3-37e0-40b1-adad-4ab79e36fc2f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:39.002207 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-77d751a3-37e0-40b1-adad-4ab79e36fc2f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:39.002988 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-77d751a3-37e0-40b1-adad-4ab79e36fc2f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:39.003410 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-77d751a3-37e0-40b1-adad-4ab79e36fc2f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:39.212512 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-77d751a3-37e0-40b1-adad-4ab79e36fc2f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:39.215781 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b138a10c-041a-44d9-bec8-62e9389edf0e tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:39.220226 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-77d751a3-37e0-40b1-adad-4ab79e36fc2f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.232251 Jan 28 20:30:39.220824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 322/623] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:38 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:39.223428 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b138a10c-041a-44d9-bec8-62e9389edf0e tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1318 microversion: 2.1 time: 0.268548 Jan 28 20:30:39.224041 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 302/624] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:38 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:39.788667 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-69d56de8-d760-4b64-a3bb-c10c127d98a2 req-018bb81a-a2bc-480a-ad51-6a84afd1c06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363cf95b-1c28-42b0-8246-4cbff39ae4a8", "name": "network-vif-plugged", "status": "completed", "tag": "5659c60c-97c6-4ce9-98c3-e9ec7e3a47df"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:39.793914 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:39.793914 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:30:39.808837 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-69d56de8-d760-4b64-a3bb-c10c127d98a2 req-018bb81a-a2bc-480a-ad51-6a84afd1c06b service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:39.808837 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-69d56de8-d760-4b64-a3bb-c10c127d98a2 req-018bb81a-a2bc-480a-ad51-6a84afd1c06b service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:39.819965 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-69d56de8-d760-4b64-a3bb-c10c127d98a2 req-018bb81a-a2bc-480a-ad51-6a84afd1c06b service nova] Creating event network-vif-plugged:5659c60c-97c6-4ce9-98c3-e9ec7e3a47df for instance 363cf95b-1c28-42b0-8246-4cbff39ae4a8 on hv-cinder-82635 Jan 28 20:30:39.826293 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-69d56de8-d760-4b64-a3bb-c10c127d98a2 req-018bb81a-a2bc-480a-ad51-6a84afd1c06b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041349 Jan 28 20:30:39.828133 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 323/625] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:39.988733 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4771bbf5-2012-43e2-bf55-485d0fb5c0d7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:39.989844 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4771bbf5-2012-43e2-bf55-485d0fb5c0d7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:39.996460 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4771bbf5-2012-43e2-bf55-485d0fb5c0d7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:39.997108 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4771bbf5-2012-43e2-bf55-485d0fb5c0d7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:39.997929 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4771bbf5-2012-43e2-bf55-485d0fb5c0d7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:39.998527 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4771bbf5-2012-43e2-bf55-485d0fb5c0d7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:40.094135 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-4771bbf5-2012-43e2-bf55-485d0fb5c0d7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lazy-loading 'services' on Instance uuid ea9423ae-529f-43f9-aee3-3f0e26568c2d {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:30:40.163590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4771bbf5-2012-43e2-bf55-485d0fb5c0d7 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments/2470b404-caae-44a0-b47b-49690d6b38e6" status: 202 len: 0 microversion: 2.1 time: 0.178307 Jan 28 20:30:40.164316 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 303/626] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:30:39 2022] DELETE /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments/2470b404-caae-44a0-b47b-49690d6b38e6 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:30:40.173716 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e67d000d-9568-4055-8272-4b8ec1f46cbe tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:40.174721 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e67d000d-9568-4055-8272-4b8ec1f46cbe tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:40.182200 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e67d000d-9568-4055-8272-4b8ec1f46cbe tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:40.183192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e67d000d-9568-4055-8272-4b8ec1f46cbe tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:40.183966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e67d000d-9568-4055-8272-4b8ec1f46cbe tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:40.184397 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e67d000d-9568-4055-8272-4b8ec1f46cbe tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:40.212682 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e67d000d-9568-4055-8272-4b8ec1f46cbe tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Jan 28 20:30:40.213249 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 324/627] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:40 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:40.240606 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7e9d0a8b-d6a8-4723-8b8d-964e8fd1b950 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:40.241674 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7e9d0a8b-d6a8-4723-8b8d-964e8fd1b950 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:40.246814 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c3c683f5-0129-4874-bf46-8d574b26b79c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:40.247607 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c3c683f5-0129-4874-bf46-8d574b26b79c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:40.248027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e9d0a8b-d6a8-4723-8b8d-964e8fd1b950 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:40.248641 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e9d0a8b-d6a8-4723-8b8d-964e8fd1b950 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:40.249576 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e9d0a8b-d6a8-4723-8b8d-964e8fd1b950 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:40.250194 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e9d0a8b-d6a8-4723-8b8d-964e8fd1b950 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:40.254663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c3c683f5-0129-4874-bf46-8d574b26b79c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:40.255119 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c3c683f5-0129-4874-bf46-8d574b26b79c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:40.255906 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c3c683f5-0129-4874-bf46-8d574b26b79c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:40.256464 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c3c683f5-0129-4874-bf46-8d574b26b79c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:40.444908 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c3c683f5-0129-4874-bf46-8d574b26b79c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:40.451878 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7e9d0a8b-d6a8-4723-8b8d-964e8fd1b950 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:40.456393 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c3c683f5-0129-4874-bf46-8d574b26b79c tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.213235 Jan 28 20:30:40.457134 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 325/628] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:40 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:40.459723 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7e9d0a8b-d6a8-4723-8b8d-964e8fd1b950 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1318 microversion: 2.1 time: 0.222999 Jan 28 20:30:40.460278 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 304/629] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:40 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:41.224640 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-282bee30-b8fd-4451-ae78-1c1c870e898e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:41.225679 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-282bee30-b8fd-4451-ae78-1c1c870e898e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:41.232032 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-282bee30-b8fd-4451-ae78-1c1c870e898e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:41.232476 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-282bee30-b8fd-4451-ae78-1c1c870e898e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:41.233262 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-282bee30-b8fd-4451-ae78-1c1c870e898e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:41.233692 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-282bee30-b8fd-4451-ae78-1c1c870e898e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:41.263841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-282bee30-b8fd-4451-ae78-1c1c870e898e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042811 Jan 28 20:30:41.264326 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 326/630] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:41 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:41.474835 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7b9fda55-bcd2-486a-8975-30e34b3c3bfb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:41.475383 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7b9fda55-bcd2-486a-8975-30e34b3c3bfb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:41.477378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cba09f06-39e1-449a-97fd-dce93add7236 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:41.478252 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-cba09f06-39e1-449a-97fd-dce93add7236 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:41.482107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7b9fda55-bcd2-486a-8975-30e34b3c3bfb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:41.482653 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7b9fda55-bcd2-486a-8975-30e34b3c3bfb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:41.483632 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7b9fda55-bcd2-486a-8975-30e34b3c3bfb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:41.484143 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7b9fda55-bcd2-486a-8975-30e34b3c3bfb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:41.485422 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cba09f06-39e1-449a-97fd-dce93add7236 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:41.485995 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cba09f06-39e1-449a-97fd-dce93add7236 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:41.486851 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cba09f06-39e1-449a-97fd-dce93add7236 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:41.487351 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cba09f06-39e1-449a-97fd-dce93add7236 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:41.707180 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7b9fda55-bcd2-486a-8975-30e34b3c3bfb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:41.709726 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cba09f06-39e1-449a-97fd-dce93add7236 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:41.716939 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7b9fda55-bcd2-486a-8975-30e34b3c3bfb tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.246341 Jan 28 20:30:41.717606 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 305/631] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:41 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:41.719663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-cba09f06-39e1-449a-97fd-dce93add7236 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1318 microversion: 2.1 time: 0.245869 Jan 28 20:30:41.721344 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 327/632] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:41 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:42.276518 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cfdda275-0bfa-4104-9603-f5900916b59b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:42.277899 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cfdda275-0bfa-4104-9603-f5900916b59b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:42.285005 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfdda275-0bfa-4104-9603-f5900916b59b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:42.285344 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfdda275-0bfa-4104-9603-f5900916b59b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:42.286415 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfdda275-0bfa-4104-9603-f5900916b59b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:42.286900 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfdda275-0bfa-4104-9603-f5900916b59b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:42.316018 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cfdda275-0bfa-4104-9603-f5900916b59b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044308 Jan 28 20:30:42.316569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 306/633] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:30:42 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 20:30:42.733909 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3c319023-e98a-462d-bb4b-ad1c3db1717f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:42.734519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3c319023-e98a-462d-bb4b-ad1c3db1717f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:42.738162 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-08da3220-5767-4732-bec5-869c27cd03af tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:42.738776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-08da3220-5767-4732-bec5-869c27cd03af tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:42.740735 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c319023-e98a-462d-bb4b-ad1c3db1717f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:42.741175 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c319023-e98a-462d-bb4b-ad1c3db1717f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:42.741983 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c319023-e98a-462d-bb4b-ad1c3db1717f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:42.742409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3c319023-e98a-462d-bb4b-ad1c3db1717f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:42.744877 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-08da3220-5767-4732-bec5-869c27cd03af tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:42.745325 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-08da3220-5767-4732-bec5-869c27cd03af tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:42.746131 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-08da3220-5767-4732-bec5-869c27cd03af tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:42.746565 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-08da3220-5767-4732-bec5-869c27cd03af tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:42.944466 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-08da3220-5767-4732-bec5-869c27cd03af tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:42.952864 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-08da3220-5767-4732-bec5-869c27cd03af tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1508 microversion: 2.1 time: 0.218249 Jan 28 20:30:42.953436 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 307/634] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:42 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:42.956353 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3c319023-e98a-462d-bb4b-ad1c3db1717f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:42.964184 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3c319023-e98a-462d-bb4b-ad1c3db1717f tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.233893 Jan 28 20:30:42.965231 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 328/635] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:42 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:42.969394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2ec98ac9-971d-46d6-905d-0653d7cac0fa tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74a40a31-c2c3-4054-a595-94ec2c7109d2", "device": "/dev/sdb"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:42.970558 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2ec98ac9-971d-46d6-905d-0653d7cac0fa tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:42.976306 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ec98ac9-971d-46d6-905d-0653d7cac0fa tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:42.976754 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ec98ac9-971d-46d6-905d-0653d7cac0fa tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:42.977538 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ec98ac9-971d-46d6-905d-0653d7cac0fa tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:42.978006 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2ec98ac9-971d-46d6-905d-0653d7cac0fa tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.207159 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2ec98ac9-971d-46d6-905d-0653d7cac0fa tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "POST /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241311 Jan 28 20:30:43.207801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 308/636] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:30:42 2022] POST /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:30:43.504572 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ccb62499-14a4-4015-a981-88ffd09c2683 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:43.504980 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ccb62499-14a4-4015-a981-88ffd09c2683 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:43.511444 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ccb62499-14a4-4015-a981-88ffd09c2683 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.511882 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ccb62499-14a4-4015-a981-88ffd09c2683 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.512639 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ccb62499-14a4-4015-a981-88ffd09c2683 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.513064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ccb62499-14a4-4015-a981-88ffd09c2683 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.536545 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ccb62499-14a4-4015-a981-88ffd09c2683 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:30:43.608397 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ccb62499-14a4-4015-a981-88ffd09c2683 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 204 len: 0 microversion: 2.1 time: 0.107116 Jan 28 20:30:43.609050 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 329/637] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:30:43 2022] DELETE /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 20:30:43.618674 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-89782992-1318-4bb1-b03b-ae2b6f9ff326 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:43.619375 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-89782992-1318-4bb1-b03b-ae2b6f9ff326 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:43.626100 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-89782992-1318-4bb1-b03b-ae2b6f9ff326 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.626547 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-89782992-1318-4bb1-b03b-ae2b6f9ff326 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.627326 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-89782992-1318-4bb1-b03b-ae2b6f9ff326 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.627758 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-89782992-1318-4bb1-b03b-ae2b6f9ff326 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.769267 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-89782992-1318-4bb1-b03b-ae2b6f9ff326 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:43.776902 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-89782992-1318-4bb1-b03b-ae2b6f9ff326 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1515 microversion: 2.1 time: 0.163070 Jan 28 20:30:43.777452 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 309/638] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:43 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:43.800756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-92808ff8-716a-46d6-a442-afd5f1cc74ce tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:43.801744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-92808ff8-716a-46d6-a442-afd5f1cc74ce tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:43.808623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-92808ff8-716a-46d6-a442-afd5f1cc74ce tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.809060 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-92808ff8-716a-46d6-a442-afd5f1cc74ce tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.809824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-92808ff8-716a-46d6-a442-afd5f1cc74ce tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.810401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-92808ff8-716a-46d6-a442-afd5f1cc74ce tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.909457 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-92808ff8-716a-46d6-a442-afd5f1cc74ce tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "POST /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b/action" status: 200 len: 29304 microversion: 2.20 time: 0.112460 Jan 28 20:30:43.910204 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 330/639] 10.222.0.59 () {62 vars in 1318 bytes} [Fri Jan 28 20:30:43 2022] POST /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b/action => generated 29304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:30:43.921620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-081ac411-a52b-43d5-8e11-34cb706fa943 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:43.922133 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-081ac411-a52b-43d5-8e11-34cb706fa943 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:43.928083 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-081ac411-a52b-43d5-8e11-34cb706fa943 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.928612 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-081ac411-a52b-43d5-8e11-34cb706fa943 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.929304 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-081ac411-a52b-43d5-8e11-34cb706fa943 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.929735 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-081ac411-a52b-43d5-8e11-34cb706fa943 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.954424 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-081ac411-a52b-43d5-8e11-34cb706fa943 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:30:43.981393 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d6dd5477-36f1-401e-b02a-a70ef72d1bd4 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:43.982102 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d6dd5477-36f1-401e-b02a-a70ef72d1bd4 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:43.989098 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6dd5477-36f1-401e-b02a-a70ef72d1bd4 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.989554 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6dd5477-36f1-401e-b02a-a70ef72d1bd4 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:43.990398 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6dd5477-36f1-401e-b02a-a70ef72d1bd4 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:43.990794 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6dd5477-36f1-401e-b02a-a70ef72d1bd4 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:44.030069 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-081ac411-a52b-43d5-8e11-34cb706fa943 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 204 len: 0 microversion: 2.20 time: 0.111697 Jan 28 20:30:44.031198 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 310/640] 10.222.0.59 () {60 vars in 1279 bytes} [Fri Jan 28 20:30:43 2022] DELETE /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 20:30:44.043885 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:44.044881 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:44.050817 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:44.051259 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:44.052042 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:44.052469 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:44.162145 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d6dd5477-36f1-401e-b02a-a70ef72d1bd4 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:44.170196 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d6dd5477-36f1-401e-b02a-a70ef72d1bd4 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.193321 Jan 28 20:30:44.170768 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 331/641] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:43 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:44.219373 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:44.228190 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:44.230399 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:44.231549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c2a57cd9-ae55-4ba9-95e9-a931cf220d39 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1724 microversion: 2.20 time: 0.192424 Jan 28 20:30:44.232104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 311/642] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:44 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:30:44.793617 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4bd6fbaf-60db-4be5-a5ac-891f1b319aa5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:44.794260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4bd6fbaf-60db-4be5-a5ac-891f1b319aa5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:44.800489 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4bd6fbaf-60db-4be5-a5ac-891f1b319aa5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:44.800930 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4bd6fbaf-60db-4be5-a5ac-891f1b319aa5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:44.801712 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4bd6fbaf-60db-4be5-a5ac-891f1b319aa5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:44.802172 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4bd6fbaf-60db-4be5-a5ac-891f1b319aa5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:44.933639 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4bd6fbaf-60db-4be5-a5ac-891f1b319aa5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:44.940988 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4bd6fbaf-60db-4be5-a5ac-891f1b319aa5 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1515 microversion: 2.1 time: 0.151013 Jan 28 20:30:44.941542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 332/643] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:44 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:45.187000 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9bcab1ea-59a4-4dd2-b519-81ae77b6a287 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:45.187607 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9bcab1ea-59a4-4dd2-b519-81ae77b6a287 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:45.193791 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9bcab1ea-59a4-4dd2-b519-81ae77b6a287 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:45.194269 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9bcab1ea-59a4-4dd2-b519-81ae77b6a287 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:45.195047 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9bcab1ea-59a4-4dd2-b519-81ae77b6a287 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:45.195478 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9bcab1ea-59a4-4dd2-b519-81ae77b6a287 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:45.249370 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:45.250004 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:45.256529 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:45.256971 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:45.257859 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:45.258331 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:45.357720 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9bcab1ea-59a4-4dd2-b519-81ae77b6a287 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:45.365551 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9bcab1ea-59a4-4dd2-b519-81ae77b6a287 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.182172 Jan 28 20:30:45.366146 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 312/644] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:45 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:45.420286 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:45.428008 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:45.429491 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:45.430668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-75422f1b-92c6-43a4-af9e-74fc56a40d92 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1724 microversion: 2.20 time: 0.185044 Jan 28 20:30:45.431342 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 333/645] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:45 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:30:45.956867 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-941a2e3d-41b3-47e6-b2d3-684e16e8da04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:45.957498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-941a2e3d-41b3-47e6-b2d3-684e16e8da04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:45.963352 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-941a2e3d-41b3-47e6-b2d3-684e16e8da04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:45.963793 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-941a2e3d-41b3-47e6-b2d3-684e16e8da04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:45.964558 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-941a2e3d-41b3-47e6-b2d3-684e16e8da04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:45.965061 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-941a2e3d-41b3-47e6-b2d3-684e16e8da04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:46.093409 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-941a2e3d-41b3-47e6-b2d3-684e16e8da04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:46.100529 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-941a2e3d-41b3-47e6-b2d3-684e16e8da04 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1515 microversion: 2.1 time: 0.147308 Jan 28 20:30:46.101142 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 313/646] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:45 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:46.382197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c3479319-49c3-407e-be56-0fc42527f62e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:46.383030 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c3479319-49c3-407e-be56-0fc42527f62e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:46.389400 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c3479319-49c3-407e-be56-0fc42527f62e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:46.389842 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c3479319-49c3-407e-be56-0fc42527f62e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:46.390710 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c3479319-49c3-407e-be56-0fc42527f62e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:46.391064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c3479319-49c3-407e-be56-0fc42527f62e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:46.448500 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:46.449102 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:46.455224 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:46.455663 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:46.456433 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:46.456860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:46.558075 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c3479319-49c3-407e-be56-0fc42527f62e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:46.565444 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c3479319-49c3-407e-be56-0fc42527f62e tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.186734 Jan 28 20:30:46.566050 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 334/647] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:46 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:46.623573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:46.631133 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:46.632612 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:46.633750 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-48505c0a-71fd-4a89-96d5-da9416c43aa6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1724 microversion: 2.20 time: 0.189118 Jan 28 20:30:46.634334 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 314/648] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:46 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:30:47.117412 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1750ab4f-b5e8-4223-a331-7736dab5f36c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:47.118081 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1750ab4f-b5e8-4223-a331-7736dab5f36c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:47.124415 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1750ab4f-b5e8-4223-a331-7736dab5f36c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:47.124884 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1750ab4f-b5e8-4223-a331-7736dab5f36c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:47.125655 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1750ab4f-b5e8-4223-a331-7736dab5f36c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:47.126100 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1750ab4f-b5e8-4223-a331-7736dab5f36c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:47.271050 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1750ab4f-b5e8-4223-a331-7736dab5f36c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:47.280007 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1750ab4f-b5e8-4223-a331-7736dab5f36c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1515 microversion: 2.1 time: 0.165552 Jan 28 20:30:47.280580 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 335/649] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:47 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:47.583143 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3eb26f0a-809f-4882-8123-b18af6e69522 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:47.583684 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3eb26f0a-809f-4882-8123-b18af6e69522 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:47.590254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3eb26f0a-809f-4882-8123-b18af6e69522 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:47.590705 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3eb26f0a-809f-4882-8123-b18af6e69522 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:47.591500 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3eb26f0a-809f-4882-8123-b18af6e69522 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:47.591934 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3eb26f0a-809f-4882-8123-b18af6e69522 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:47.655213 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:47.656120 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:47.663940 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:47.664482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:47.665349 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:47.665854 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:47.995578 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3eb26f0a-809f-4882-8123-b18af6e69522 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:48.003588 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:48.011275 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3eb26f0a-809f-4882-8123-b18af6e69522 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1520 microversion: 2.1 time: 0.431617 Jan 28 20:30:48.011941 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 315/650] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:47 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:48.012209 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:48.014370 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:48.015543 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8c263282-76aa-41a0-955d-cd5c929b7334 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1724 microversion: 2.20 time: 0.364409 Jan 28 20:30:48.016230 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 336/651] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:47 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:30:48.297736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-da7e2e65-3295-4e80-bc4d-05df9097fb81 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:48.298414 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-da7e2e65-3295-4e80-bc4d-05df9097fb81 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:48.304379 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-da7e2e65-3295-4e80-bc4d-05df9097fb81 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:48.304823 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-da7e2e65-3295-4e80-bc4d-05df9097fb81 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:48.305608 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-da7e2e65-3295-4e80-bc4d-05df9097fb81 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:48.306068 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-da7e2e65-3295-4e80-bc4d-05df9097fb81 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:48.446439 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-da7e2e65-3295-4e80-bc4d-05df9097fb81 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:48.453832 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-da7e2e65-3295-4e80-bc4d-05df9097fb81 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1515 microversion: 2.1 time: 0.161114 Jan 28 20:30:48.454676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 316/652] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:48 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:48.974103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-8707f00a-aae6-4160-8125-f10dd03d061a req-3be3d052-39b8-47d3-8e6c-baab82245945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd446032-56d9-4e84-abd4-85bc3acbc24b", "name": "network-vif-deleted", "tag": "37507c9d-22d6-4b55-b7be-87e04e27d5d1"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:48.976982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:48.976982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:30:48.998853 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-8707f00a-aae6-4160-8125-f10dd03d061a req-3be3d052-39b8-47d3-8e6c-baab82245945 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:48.999271 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-8707f00a-aae6-4160-8125-f10dd03d061a req-3be3d052-39b8-47d3-8e6c-baab82245945 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:49.029718 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3b6ad095-21c1-407c-bc1c-bd84e259a894 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:49.031756 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3b6ad095-21c1-407c-bc1c-bd84e259a894 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:49.032311 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-8707f00a-aae6-4160-8125-f10dd03d061a req-3be3d052-39b8-47d3-8e6c-baab82245945 service nova] Creating event network-vif-deleted:37507c9d-22d6-4b55-b7be-87e04e27d5d1 for instance dd446032-56d9-4e84-abd4-85bc3acbc24b on hv-cinder-82635 Jan 28 20:30:49.038728 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-8707f00a-aae6-4160-8125-f10dd03d061a req-3be3d052-39b8-47d3-8e6c-baab82245945 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069873 Jan 28 20:30:49.039903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 337/653] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:49.046702 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:49.047576 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:49.052773 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b6ad095-21c1-407c-bc1c-bd84e259a894 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:49.055471 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b6ad095-21c1-407c-bc1c-bd84e259a894 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:49.055963 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:49.056568 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:49.057558 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:49.058219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:49.064811 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b6ad095-21c1-407c-bc1c-bd84e259a894 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:49.067639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b6ad095-21c1-407c-bc1c-bd84e259a894 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:49.152495 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:49.162497 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:49.164639 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:49.166017 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d9b299df-b9ee-49e6-aa9b-663312c70e7d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1367 microversion: 2.20 time: 0.124703 Jan 28 20:30:49.168625 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 338/654] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:49 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1367 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:30:49.205650 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3b6ad095-21c1-407c-bc1c-bd84e259a894 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:49.215175 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3b6ad095-21c1-407c-bc1c-bd84e259a894 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1478 microversion: 2.1 time: 0.190163 Jan 28 20:30:49.217302 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 317/655] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:49 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1478 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:49.471623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:49.472463 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:49.478548 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:49.479107 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:49.479962 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:49.480466 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:49.510337 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:49.510782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:49.511243 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lazy-loading 'fault' on Instance uuid ea9423ae-529f-43f9-aee3-3f0e26568c2d {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:30:49.569359 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:49.578805 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0e037cf8-e49f-4103-ab15-aa5c4137fe8e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 200 len: 1308 microversion: 2.1 time: 0.110217 Jan 28 20:30:49.589279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 339/656] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:49 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:50.187464 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:50.189429 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:50.199490 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:50.200104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:50.202189 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:50.203083 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:50.238164 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:50.239834 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:50.264057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:50.264825 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:50.265963 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:50.266405 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:50.284260 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:50.284701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:50.285164 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lazy-loading 'fault' on Instance uuid dd446032-56d9-4e84-abd4-85bc3acbc24b {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:30:50.350346 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:50.352352 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:50.352532 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:50.353462 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lazy-loading 'fault' on Instance uuid 0d03f1de-078d-4fff-aec4-7c91aaaa1eed {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:30:50.363801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:50.365743 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:50.367217 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f33ca3d9-5b1d-499e-943e-190445403407 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 200 len: 1372 microversion: 2.20 time: 0.186010 Jan 28 20:30:50.368089 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 318/657] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:50 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:30:50.421646 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545d8edb84904f639777764fca8f7b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f6f9108399481680b96ea944fe5387', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:50.437708 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a7b04a84-5d36-4fe6-909e-e78ae649a6f7 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 200 len: 1311 microversion: 2.1 time: 0.208474 Jan 28 20:30:50.438920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 340/658] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:50 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:50.596389 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-98d01abf-ebcf-4b87-8d88-557827aab111 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:50.596918 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-98d01abf-ebcf-4b87-8d88-557827aab111 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: ea9423ae-529f-43f9-aee3-3f0e26568c2d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:50.603350 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98d01abf-ebcf-4b87-8d88-557827aab111 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:50.603944 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98d01abf-ebcf-4b87-8d88-557827aab111 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:50.604735 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98d01abf-ebcf-4b87-8d88-557827aab111 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:50.605161 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98d01abf-ebcf-4b87-8d88-557827aab111 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:50.619898 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-98d01abf-ebcf-4b87-8d88-557827aab111 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] HTTP exception thrown: Instance ea9423ae-529f-43f9-aee3-3f0e26568c2d could not be found. Jan 28 20:30:50.620539 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-98d01abf-ebcf-4b87-8d88-557827aab111 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Returning 404 to user: Instance ea9423ae-529f-43f9-aee3-3f0e26568c2d could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:30:50.621436 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-98d01abf-ebcf-4b87-8d88-557827aab111 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d" status: 404 len: 111 microversion: 2.1 time: 0.029074 Jan 28 20:30:50.624909 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 319/659] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:50 2022] GET /compute/v2.1/servers/ea9423ae-529f-43f9-aee3-3f0e26568c2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:30:51.064959 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-cd404c8e-8716-41d3-8e24-f8f3c2dbc241 req-522fd475-93d7-4ff1-b169-f5b9805fb7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9423ae-529f-43f9-aee3-3f0e26568c2d", "name": "network-vif-deleted", "tag": "7729b1e2-04d5-4718-a7e9-ae9ecf6b8332"}, {"server_uuid": "0d03f1de-078d-4fff-aec4-7c91aaaa1eed", "name": "network-vif-deleted", "tag": "0b4a5fea-0598-489d-9e45-fc3ffbb44916"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:51.066775 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:51.066775 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:30:51.074674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-cd404c8e-8716-41d3-8e24-f8f3c2dbc241 req-522fd475-93d7-4ff1-b169-f5b9805fb7e1 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:51.075109 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-cd404c8e-8716-41d3-8e24-f8f3c2dbc241 req-522fd475-93d7-4ff1-b169-f5b9805fb7e1 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:51.088073 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-cd404c8e-8716-41d3-8e24-f8f3c2dbc241 req-522fd475-93d7-4ff1-b169-f5b9805fb7e1 service nova] Creating event network-vif-deleted:7729b1e2-04d5-4718-a7e9-ae9ecf6b8332 for instance ea9423ae-529f-43f9-aee3-3f0e26568c2d on hv-cinder-82635 Jan 28 20:30:51.088573 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-cd404c8e-8716-41d3-8e24-f8f3c2dbc241 req-522fd475-93d7-4ff1-b169-f5b9805fb7e1 service nova] Creating event network-vif-deleted:0b4a5fea-0598-489d-9e45-fc3ffbb44916 for instance 0d03f1de-078d-4fff-aec4-7c91aaaa1eed on hv-cinder-82635 Jan 28 20:30:51.095071 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-cd404c8e-8716-41d3-8e24-f8f3c2dbc241 req-522fd475-93d7-4ff1-b169-f5b9805fb7e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034261 Jan 28 20:30:51.096064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 341/660] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:51.385904 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6de71881-1205-44cf-93ca-73e93fcfde82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:51.386551 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6de71881-1205-44cf-93ca-73e93fcfde82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:51.393498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6de71881-1205-44cf-93ca-73e93fcfde82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:51.393979 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6de71881-1205-44cf-93ca-73e93fcfde82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:51.394765 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6de71881-1205-44cf-93ca-73e93fcfde82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:51.395197 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6de71881-1205-44cf-93ca-73e93fcfde82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:51.408937 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-6de71881-1205-44cf-93ca-73e93fcfde82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] HTTP exception thrown: Instance dd446032-56d9-4e84-abd4-85bc3acbc24b could not be found. Jan 28 20:30:51.409534 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6de71881-1205-44cf-93ca-73e93fcfde82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Returning 404 to user: Instance dd446032-56d9-4e84-abd4-85bc3acbc24b could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:30:51.410388 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6de71881-1205-44cf-93ca-73e93fcfde82 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 404 len: 111 microversion: 2.20 time: 0.028426 Jan 28 20:30:51.411683 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 320/661] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:51 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 20:30:51.420688 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-14f83171-644e-4463-8515-94546ed77384 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '.version_select at 0x7fc779dc75e0>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:51.454858 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-14f83171-644e-4463-8515-94546ed77384 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597116798" status: 204 len: 0 microversion: 2.20 time: 0.039011 Jan 28 20:30:51.455341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 342/662] 10.222.0.59 () {60 vars in 1261 bytes} [Fri Jan 28 20:30:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597116798 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 20:30:51.460004 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6cdcfd28-1c88-41c1-a3e9-8e845230fc92 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:51.460632 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6cdcfd28-1c88-41c1-a3e9-8e845230fc92 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] [instance: 0d03f1de-078d-4fff-aec4-7c91aaaa1eed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:51.467087 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6cdcfd28-1c88-41c1-a3e9-8e845230fc92 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:51.467543 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6cdcfd28-1c88-41c1-a3e9-8e845230fc92 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:51.468317 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6cdcfd28-1c88-41c1-a3e9-8e845230fc92 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:51.468931 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6cdcfd28-1c88-41c1-a3e9-8e845230fc92 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:51.482096 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-6cdcfd28-1c88-41c1-a3e9-8e845230fc92 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] HTTP exception thrown: Instance 0d03f1de-078d-4fff-aec4-7c91aaaa1eed could not be found. Jan 28 20:30:51.483391 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6cdcfd28-1c88-41c1-a3e9-8e845230fc92 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] Returning 404 to user: Instance 0d03f1de-078d-4fff-aec4-7c91aaaa1eed could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:30:51.484209 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6cdcfd28-1c88-41c1-a3e9-8e845230fc92 tempest-ServerRescueNegativeTestJSON-1698607411 tempest-ServerRescueNegativeTestJSON-1698607411-project] 10.222.0.59 "GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed" status: 404 len: 111 microversion: 2.1 time: 0.032260 Jan 28 20:30:51.484930 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 321/663] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:51 2022] GET /compute/v2.1/servers/0d03f1de-078d-4fff-aec4-7c91aaaa1eed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 20:30:51.754536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-02a80bad-e69e-4fde-96ae-e3afd04f45fb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:51.755154 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-02a80bad-e69e-4fde-96ae-e3afd04f45fb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:51.761420 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-02a80bad-e69e-4fde-96ae-e3afd04f45fb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:51.761811 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-02a80bad-e69e-4fde-96ae-e3afd04f45fb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:51.762629 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-02a80bad-e69e-4fde-96ae-e3afd04f45fb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:51.763066 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-02a80bad-e69e-4fde-96ae-e3afd04f45fb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:51.789946 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-02a80bad-e69e-4fde-96ae-e3afd04f45fb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:30:51.878103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-02a80bad-e69e-4fde-96ae-e3afd04f45fb tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 204 len: 0 microversion: 2.1 time: 0.126939 Jan 28 20:30:51.879102 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 343/664] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:30:51 2022] DELETE /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:30:51.888285 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-95a9ee35-8993-4e15-aeda-42f37beb3a9b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:51.889349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-95a9ee35-8993-4e15-aeda-42f37beb3a9b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:51.897426 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-95a9ee35-8993-4e15-aeda-42f37beb3a9b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:51.898767 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-95a9ee35-8993-4e15-aeda-42f37beb3a9b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:51.899863 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-95a9ee35-8993-4e15-aeda-42f37beb3a9b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:51.901515 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-95a9ee35-8993-4e15-aeda-42f37beb3a9b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:52.191205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f646e6c4-1652-42fd-ab3b-e551d89dbf1c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Action: 'create', calling method: .version_select at 0x7fc779f84f70>, body: {"keypair": {"name": "tempest-keypair-1006605285"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:52.209377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-f646e6c4-1652-42fd-ab3b-e551d89dbf1c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for project 51269d658f0540dab6086a21ebd9e00f. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:30:52.213247 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-f646e6c4-1652-42fd-ab3b-e551d89dbf1c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for user a80b14067e3245c49fbbde4ca5f0bf76 and project 51269d658f0540dab6086a21ebd9e00f. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:30:52.246218 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-95a9ee35-8993-4e15-aeda-42f37beb3a9b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:52.253712 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-95a9ee35-8993-4e15-aeda-42f37beb3a9b tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1514 microversion: 2.1 time: 0.370866 Jan 28 20:30:52.254294 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 322/665] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:51 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1514 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:52.425082 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-f646e6c4-1652-42fd-ab3b-e551d89dbf1c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for project 51269d658f0540dab6086a21ebd9e00f. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:30:52.428988 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-f646e6c4-1652-42fd-ab3b-e551d89dbf1c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for user a80b14067e3245c49fbbde4ca5f0bf76 and project 51269d658f0540dab6086a21ebd9e00f. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:30:52.441805 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f646e6c4-1652-42fd-ab3b-e551d89dbf1c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.254652 Jan 28 20:30:52.442445 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 344/666] 10.222.0.59 () {62 vars in 1198 bytes} [Fri Jan 28 20:30:52 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 257 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 28 20:30:53.270459 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f34bbb12-245a-450b-a85b-d49118119996 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:53.271073 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f34bbb12-245a-450b-a85b-d49118119996 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:53.279688 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34bbb12-245a-450b-a85b-d49118119996 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:53.280071 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34bbb12-245a-450b-a85b-d49118119996 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:53.280853 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34bbb12-245a-450b-a85b-d49118119996 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:53.281457 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34bbb12-245a-450b-a85b-d49118119996 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:53.779666 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f34bbb12-245a-450b-a85b-d49118119996 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:53.790648 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f34bbb12-245a-450b-a85b-d49118119996 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1514 microversion: 2.1 time: 0.521307 Jan 28 20:30:53.792430 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 323/667] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:53 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1514 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:54.067157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-8161448", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6189d54-a943-4614-aea9-0a741e80c5fa"}], "security_groups": [{"name": "tempest-securitygroup--1233068765"}], "key_name": "tempest-keypair-1006605285", "user_data": "}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:54.202252 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] validate_networks() for [('e6189d54-a943-4614-aea9-0a741e80c5fa', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:30:54.808034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c3497f38-5a43-46cd-88d1-768e186acad6 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:54.808794 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c3497f38-5a43-46cd-88d1-768e186acad6 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:54.815131 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3497f38-5a43-46cd-88d1-768e186acad6 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:54.815703 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3497f38-5a43-46cd-88d1-768e186acad6 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:54.816612 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3497f38-5a43-46cd-88d1-768e186acad6 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:54.817145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3497f38-5a43-46cd-88d1-768e186acad6 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:54.919356 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:30:54.919809 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:30:54.920328 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:30:54.920733 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:30:54.921337 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:30:54.932293 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:54.932745 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:54.933559 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:54.934034 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:54.955707 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for project 51269d658f0540dab6086a21ebd9e00f. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:30:54.960273 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Getting quotas for user a80b14067e3245c49fbbde4ca5f0bf76 and project 51269d658f0540dab6086a21ebd9e00f. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:30:54.972243 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:30:54.974698 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:30:54.993081 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c3497f38-5a43-46cd-88d1-768e186acad6 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:55.001567 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c3497f38-5a43-46cd-88d1-768e186acad6 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1514 microversion: 2.1 time: 0.197047 Jan 28 20:30:55.013001 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 324/668] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:54 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:30:55.022460 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4918cdfc-0d97-43bb-a472-ddcfac16663d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.959304 Jan 28 20:30:55.023627 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 345/669] 10.222.0.59 () {62 vars in 1187 bytes} [Fri Jan 28 20:30:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 20:30:55.038831 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f9deca4c-9eb6-4de2-93d4-339e05c9fa6f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:55.039444 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f9deca4c-9eb6-4de2-93d4-339e05c9fa6f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:55.113990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f9deca4c-9eb6-4de2-93d4-339e05c9fa6f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:55.122091 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f9deca4c-9eb6-4de2-93d4-339e05c9fa6f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:55.123674 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f9deca4c-9eb6-4de2-93d4-339e05c9fa6f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:55.124776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f9deca4c-9eb6-4de2-93d4-339e05c9fa6f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1279 microversion: 2.20 time: 0.089737 Jan 28 20:30:55.127128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 325/670] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:55 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:30:56.020315 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8c92a430-d6f5-48a9-8638-9ccdc4f1ead2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:56.021143 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8c92a430-d6f5-48a9-8638-9ccdc4f1ead2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:56.028269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c92a430-d6f5-48a9-8638-9ccdc4f1ead2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:56.028759 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c92a430-d6f5-48a9-8638-9ccdc4f1ead2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:56.029524 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c92a430-d6f5-48a9-8638-9ccdc4f1ead2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:56.030229 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8c92a430-d6f5-48a9-8638-9ccdc4f1ead2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:56.143783 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:56.145108 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:56.154843 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:56.156270 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:56.157270 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:56.162419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:56.190680 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8c92a430-d6f5-48a9-8638-9ccdc4f1ead2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:56.200205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8c92a430-d6f5-48a9-8638-9ccdc4f1ead2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1514 microversion: 2.1 time: 0.185007 Jan 28 20:30:56.211903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 346/671] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:56 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:56.235306 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:56.242984 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:56.244700 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:56.245808 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9ea4d1c7-e947-4c5b-829e-41516c2a4a80 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1331 microversion: 2.20 time: 0.107107 Jan 28 20:30:56.246638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 326/672] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:56 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:30:57.224751 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-950d2a39-a1b2-418b-af31-2ec321c9a47d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:57.225536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-950d2a39-a1b2-418b-af31-2ec321c9a47d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:57.231947 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-950d2a39-a1b2-418b-af31-2ec321c9a47d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:57.232528 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-950d2a39-a1b2-418b-af31-2ec321c9a47d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:57.233930 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-950d2a39-a1b2-418b-af31-2ec321c9a47d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:57.234645 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-950d2a39-a1b2-418b-af31-2ec321c9a47d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:57.268203 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:57.268970 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:57.276935 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:57.277763 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:57.278718 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:57.279983 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:57.504894 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-950d2a39-a1b2-418b-af31-2ec321c9a47d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:57.514132 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-950d2a39-a1b2-418b-af31-2ec321c9a47d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1514 microversion: 2.1 time: 0.299077 Jan 28 20:30:57.515346 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 347/673] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:57 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:57.565798 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:57.574667 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:57.577209 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:57.578391 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-039a2e77-a115-455f-ad3b-60638e301522 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.318302 Jan 28 20:30:57.579003 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 327/674] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:57 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:30:58.137920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-635f59d5-b663-4fa9-b8cc-5f393a208e46 req-5480b26e-835a-4aa8-8f16-10f7bf25d84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc7cc38-742f-4269-8cb6-7cf3e97f1654", "tag": "2b3708de-bc79-4020-8e5f-b6aecdd43ef2"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:30:58.139630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:30:58.139630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:30:58.161490 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-635f59d5-b663-4fa9-b8cc-5f393a208e46 req-5480b26e-835a-4aa8-8f16-10f7bf25d84d service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:58.162126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-635f59d5-b663-4fa9-b8cc-5f393a208e46 req-5480b26e-835a-4aa8-8f16-10f7bf25d84d service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:58.180501 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-635f59d5-b663-4fa9-b8cc-5f393a208e46 req-5480b26e-835a-4aa8-8f16-10f7bf25d84d service nova] Creating event network-changed:2b3708de-bc79-4020-8e5f-b6aecdd43ef2 for instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 on hv-cinder-82635 Jan 28 20:30:58.192670 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-635f59d5-b663-4fa9-b8cc-5f393a208e46 req-5480b26e-835a-4aa8-8f16-10f7bf25d84d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058266 Jan 28 20:30:58.193688 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 348/675] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:30:58.533214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-bd886726-dcc4-4c11-bb29-fa87af5f78ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:58.540211 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-bd886726-dcc4-4c11-bb29-fa87af5f78ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:58.556060 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-bd886726-dcc4-4c11-bb29-fa87af5f78ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:58.556826 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-bd886726-dcc4-4c11-bb29-fa87af5f78ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:58.557848 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-bd886726-dcc4-4c11-bb29-fa87af5f78ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:58.561241 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-bd886726-dcc4-4c11-bb29-fa87af5f78ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:58.597802 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:30:58.598540 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:30:58.604529 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:58.604972 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:58.605756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:30:58.606228 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:30:59.085519 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-bd886726-dcc4-4c11-bb29-fa87af5f78ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:59.093141 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-bd886726-dcc4-4c11-bb29-fa87af5f78ad tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1514 microversion: 2.1 time: 0.564060 Jan 28 20:30:59.094231 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 328/676] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:30:58 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1514 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:30:59.161138 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:59.169132 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:59.170692 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:30:59.171812 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f74692ff-2515-4a76-8ab0-f5e11c43eb2f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.578467 Jan 28 20:30:59.172374 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 349/677] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:30:58 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:31:00.110789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f63eb548-b6e4-4bc2-82dd-6df27925096c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:00.111335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f63eb548-b6e4-4bc2-82dd-6df27925096c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:00.117593 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f63eb548-b6e4-4bc2-82dd-6df27925096c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:00.118063 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f63eb548-b6e4-4bc2-82dd-6df27925096c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:00.119126 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f63eb548-b6e4-4bc2-82dd-6df27925096c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:00.119561 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f63eb548-b6e4-4bc2-82dd-6df27925096c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:00.190391 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:00.191746 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:00.201857 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:00.202617 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:00.203548 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:00.204578 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:00.404118 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f63eb548-b6e4-4bc2-82dd-6df27925096c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:00.411360 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f63eb548-b6e4-4bc2-82dd-6df27925096c tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1514 microversion: 2.1 time: 0.304801 Jan 28 20:31:00.412467 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 329/678] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:00 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:00.477258 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:00.487198 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:00.489005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:00.490272 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-72386136-036b-40ee-9329-8418a3bc1089 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.303709 Jan 28 20:31:00.490966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 350/679] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:00 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:31:01.428369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6ba0660f-bb38-418a-b1e6-8a2e6484744d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:01.428987 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6ba0660f-bb38-418a-b1e6-8a2e6484744d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:01.436031 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6ba0660f-bb38-418a-b1e6-8a2e6484744d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:01.436478 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6ba0660f-bb38-418a-b1e6-8a2e6484744d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:01.437263 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6ba0660f-bb38-418a-b1e6-8a2e6484744d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:01.437830 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6ba0660f-bb38-418a-b1e6-8a2e6484744d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:01.623835 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3b44094e-fbdc-431d-a5ff-c9ebd97b712f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'create', calling method: .version_select at 0x7fc779dee160>, body: {"keypair": {"name": "tempest-keypair-1310052902"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:01.639986 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-3b44094e-fbdc-431d-a5ff-c9ebd97b712f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:31:01.644646 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-3b44094e-fbdc-431d-a5ff-c9ebd97b712f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for user d078a621ec024fc287d6c8bb8c44679e and project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:31:01.844071 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6ba0660f-bb38-418a-b1e6-8a2e6484744d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:01.852039 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6ba0660f-bb38-418a-b1e6-8a2e6484744d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1514 microversion: 2.1 time: 0.427307 Jan 28 20:31:01.861717 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 330/680] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:01 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:01.867967 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:01.868580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:01.877789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:01.878483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:01.879274 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:01.879882 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:02.052513 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:02.063966 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:02.065718 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:02.066924 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f9018c84-0cc3-44c0-82a8-5ae0349178a3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.203846 Jan 28 20:31:02.067657 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 331/681] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:01 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:31:02.100186 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-3b44094e-fbdc-431d-a5ff-c9ebd97b712f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:31:02.103893 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-3b44094e-fbdc-431d-a5ff-c9ebd97b712f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for user d078a621ec024fc287d6c8bb8c44679e and project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:31:02.118015 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3b44094e-fbdc-431d-a5ff-c9ebd97b712f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.653004 Jan 28 20:31:02.118709 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 351/682] 10.222.0.59 () {60 vars in 1157 bytes} [Fri Jan 28 20:31:01 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:02.868718 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c824dfc5-7e79-4e24-b417-611ea9bb71f0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:02.869331 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c824dfc5-7e79-4e24-b417-611ea9bb71f0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:02.877509 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c824dfc5-7e79-4e24-b417-611ea9bb71f0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:02.877509 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c824dfc5-7e79-4e24-b417-611ea9bb71f0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:02.878282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c824dfc5-7e79-4e24-b417-611ea9bb71f0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:02.878917 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c824dfc5-7e79-4e24-b417-611ea9bb71f0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:03.085679 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:03.086580 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:03.093279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:03.093978 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:03.094948 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:03.095387 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:03.117272 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c824dfc5-7e79-4e24-b417-611ea9bb71f0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:03.138850 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c824dfc5-7e79-4e24-b417-611ea9bb71f0 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 200 len: 1514 microversion: 2.1 time: 0.273730 Jan 28 20:31:03.139438 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 332/683] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:02 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:03.203327 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-293dd990-9061-475f-b562-fdfb94f73f97 req-0e294696-68c8-42c8-8407-1d5b89b71b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb895887-c105-49c8-8ebb-6f2d7327a46c", "name": "network-vif-deleted", "tag": "e0e35fd9-2a9a-446e-bf87-14668877b787"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:03.204899 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:31:03.204899 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:31:03.215522 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-293dd990-9061-475f-b562-fdfb94f73f97 req-0e294696-68c8-42c8-8407-1d5b89b71b08 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:03.216196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-293dd990-9061-475f-b562-fdfb94f73f97 req-0e294696-68c8-42c8-8407-1d5b89b71b08 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:03.228630 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-293dd990-9061-475f-b562-fdfb94f73f97 req-0e294696-68c8-42c8-8407-1d5b89b71b08 service nova] Creating event network-vif-deleted:e0e35fd9-2a9a-446e-bf87-14668877b787 for instance cb895887-c105-49c8-8ebb-6f2d7327a46c on hv-cinder-82635 Jan 28 20:31:03.235382 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-293dd990-9061-475f-b562-fdfb94f73f97 req-0e294696-68c8-42c8-8407-1d5b89b71b08 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035583 Jan 28 20:31:03.236112 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 333/684] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:31:03.392881 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:03.405010 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:03.406538 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:03.407649 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f32bfd3a-d8ff-4db5-9ff1-197847887259 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.326660 Jan 28 20:31:03.408447 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 352/685] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:03 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:31:03.773791 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1981667952", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb79ac15-c1bc-4519-8571-57377ab7b400"}], "security_groups": [{"name": "tempest-securitygroup--863771908"}], "key_name": "tempest-keypair-1310052902", "user_data": "}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:03.909653 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] validate_networks() for [('eb79ac15-c1bc-4519-8571-57377ab7b400', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:31:04.155013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f9e3e933-7b45-4048-bde2-027133198fef tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:04.155945 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f9e3e933-7b45-4048-bde2-027133198fef tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: cb895887-c105-49c8-8ebb-6f2d7327a46c] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:04.163339 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f9e3e933-7b45-4048-bde2-027133198fef tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.163939 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f9e3e933-7b45-4048-bde2-027133198fef tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.164960 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f9e3e933-7b45-4048-bde2-027133198fef tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.165488 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f9e3e933-7b45-4048-bde2-027133198fef tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.182150 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-f9e3e933-7b45-4048-bde2-027133198fef tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] HTTP exception thrown: Instance cb895887-c105-49c8-8ebb-6f2d7327a46c could not be found. Jan 28 20:31:04.182945 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f9e3e933-7b45-4048-bde2-027133198fef tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Returning 404 to user: Instance cb895887-c105-49c8-8ebb-6f2d7327a46c could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:31:04.183900 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f9e3e933-7b45-4048-bde2-027133198fef tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c" status: 404 len: 111 microversion: 2.1 time: 0.032780 Jan 28 20:31:04.184531 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 353/686] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:04 2022] GET /compute/v2.1/servers/cb895887-c105-49c8-8ebb-6f2d7327a46c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 20:31:04.193347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-dd30e31e-ca19-4d18-987a-91127c5b1670 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:04.194196 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-dd30e31e-ca19-4d18-987a-91127c5b1670 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:04.201648 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dd30e31e-ca19-4d18-987a-91127c5b1670 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.202147 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dd30e31e-ca19-4d18-987a-91127c5b1670 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.202951 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dd30e31e-ca19-4d18-987a-91127c5b1670 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.203383 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dd30e31e-ca19-4d18-987a-91127c5b1670 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.237701 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-dd30e31e-ca19-4d18-987a-91127c5b1670 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:31:04.334177 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-dd30e31e-ca19-4d18-987a-91127c5b1670 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "DELETE /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 204 len: 0 microversion: 2.1 time: 0.140982 Jan 28 20:31:04.335827 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 354/687] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:31:04 2022] DELETE /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 20:31:04.354349 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-65f1b5ce-d6db-477b-af78-17d716b61034 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:04.355827 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-65f1b5ce-d6db-477b-af78-17d716b61034 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:04.367924 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-65f1b5ce-d6db-477b-af78-17d716b61034 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.368519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-65f1b5ce-d6db-477b-af78-17d716b61034 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.370064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-65f1b5ce-d6db-477b-af78-17d716b61034 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.370641 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-65f1b5ce-d6db-477b-af78-17d716b61034 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.397610 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:31:04.398359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:31:04.399225 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:31:04.400212 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:31:04.401259 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:31:04.416232 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.416981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.417799 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.418320 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.445147 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:31:04.449614 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for user d078a621ec024fc287d6c8bb8c44679e and project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:31:04.462228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:31:04.465001 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:31:04.548552 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f2e11fa3-effb-469e-af9a-066941b311ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.784879 Jan 28 20:31:04.550728 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 334/688] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:31:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:31:04.562701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:04.563413 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:04.580574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.582347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.583450 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:04.585233 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:04.716559 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-65f1b5ce-d6db-477b-af78-17d716b61034 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:04.727228 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-65f1b5ce-d6db-477b-af78-17d716b61034 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1514 microversion: 2.1 time: 0.387305 Jan 28 20:31:04.728616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 355/689] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:04 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1514 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:04.733530 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-60ffc573-6092-401a-89f4-4d108c4b5ff0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:04.734162 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-60ffc573-6092-401a-89f4-4d108c4b5ff0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:04.816076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-60ffc573-6092-401a-89f4-4d108c4b5ff0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:04.823890 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-60ffc573-6092-401a-89f4-4d108c4b5ff0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1238 microversion: 2.1 time: 0.094113 Jan 28 20:31:04.824871 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 356/690] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:04 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:04.846791 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:04.855120 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:04.860423 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:04.862151 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-64d27db0-32a3-4816-8402-6cc126b81546 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.309038 Jan 28 20:31:04.863025 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 335/691] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:04 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:31:05.745779 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bf353056-4885-4399-b445-e3f61edd7edd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:05.748771 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bf353056-4885-4399-b445-e3f61edd7edd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:05.763572 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bf353056-4885-4399-b445-e3f61edd7edd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:05.764088 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bf353056-4885-4399-b445-e3f61edd7edd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:05.766330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bf353056-4885-4399-b445-e3f61edd7edd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:05.767469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bf353056-4885-4399-b445-e3f61edd7edd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:05.842184 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-908f6c64-e0c8-4bc6-8d1e-9c71aa35b989 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:05.842784 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-908f6c64-e0c8-4bc6-8d1e-9c71aa35b989 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:05.851397 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-908f6c64-e0c8-4bc6-8d1e-9c71aa35b989 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:05.852452 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-908f6c64-e0c8-4bc6-8d1e-9c71aa35b989 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:05.853412 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-908f6c64-e0c8-4bc6-8d1e-9c71aa35b989 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:05.854029 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-908f6c64-e0c8-4bc6-8d1e-9c71aa35b989 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:05.963004 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-908f6c64-e0c8-4bc6-8d1e-9c71aa35b989 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:05.975145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-908f6c64-e0c8-4bc6-8d1e-9c71aa35b989 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1298 microversion: 2.1 time: 0.135896 Jan 28 20:31:05.976192 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 336/692] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:05 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:05.987330 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:05.990385 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:06.007273 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:06.007814 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:06.008714 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:06.009221 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:06.016660 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bf353056-4885-4399-b445-e3f61edd7edd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:06.024567 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bf353056-4885-4399-b445-e3f61edd7edd tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1514 microversion: 2.1 time: 0.283434 Jan 28 20:31:06.025139 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 357/693] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:05 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:06.163328 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:06.173656 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:06.175183 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:06.176290 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e54ea1a3-c51e-443f-945d-f7fb521315d6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.197666 Jan 28 20:31:06.186578 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 337/694] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:05 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:31:06.813374 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9847eeb0-0c9f-467a-b774-67f54076855d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:06.814224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9847eeb0-0c9f-467a-b774-67f54076855d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:06.820110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9847eeb0-0c9f-467a-b774-67f54076855d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:06.820549 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9847eeb0-0c9f-467a-b774-67f54076855d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:06.821329 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9847eeb0-0c9f-467a-b774-67f54076855d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:06.821758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9847eeb0-0c9f-467a-b774-67f54076855d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:06.908890 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-9847eeb0-0c9f-467a-b774-67f54076855d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lazy-loading 'services' on Instance uuid 363cf95b-1c28-42b0-8246-4cbff39ae4a8 {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:31:06.982081 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9847eeb0-0c9f-467a-b774-67f54076855d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "DELETE /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8/os-volume_attachments/74a40a31-c2c3-4054-a595-94ec2c7109d2" status: 202 len: 0 microversion: 2.1 time: 0.171269 Jan 28 20:31:06.982692 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 358/695] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:31:06 2022] DELETE /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8/os-volume_attachments/74a40a31-c2c3-4054-a595-94ec2c7109d2 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:31:06.992677 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a2395dec-14b5-48f0-bd40-e3e237430034 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:06.994251 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a2395dec-14b5-48f0-bd40-e3e237430034 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:07.002988 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a2395dec-14b5-48f0-bd40-e3e237430034 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:07.003783 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a2395dec-14b5-48f0-bd40-e3e237430034 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:07.004879 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a2395dec-14b5-48f0-bd40-e3e237430034 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:07.005674 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a2395dec-14b5-48f0-bd40-e3e237430034 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:07.052434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9bcdc5bc-5695-4628-92a8-252029bd54d2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:07.052434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9bcdc5bc-5695-4628-92a8-252029bd54d2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:07.052434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9bcdc5bc-5695-4628-92a8-252029bd54d2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:07.052434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9bcdc5bc-5695-4628-92a8-252029bd54d2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:07.053724 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9bcdc5bc-5695-4628-92a8-252029bd54d2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:07.054263 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9bcdc5bc-5695-4628-92a8-252029bd54d2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:07.221210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a2395dec-14b5-48f0-bd40-e3e237430034 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:07.231290 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a2395dec-14b5-48f0-bd40-e3e237430034 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.242714 Jan 28 20:31:07.241545 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 338/696] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:06 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:07.248473 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:07.249254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:07.256177 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:07.257081 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:07.257937 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:07.258368 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:07.259452 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9bcdc5bc-5695-4628-92a8-252029bd54d2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:07.268632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9bcdc5bc-5695-4628-92a8-252029bd54d2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 200 len: 1514 microversion: 2.1 time: 0.230429 Jan 28 20:31:07.269373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 359/697] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:07 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:07.423027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:07.431051 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:07.432661 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:07.433840 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-30fcd471-ae3a-4dc3-b46b-678772e49a2c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.190988 Jan 28 20:31:07.434514 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 339/698] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:07 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:31:07.626234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-11b42e6a-f238-453a-89a6-55d350217a64 req-1a0ed5d9-3ca2-4c96-b457-34287657ecee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c701840-780a-4c1e-83e3-d03c2b53b0ed", "tag": "4843d0bf-c438-4f38-b995-bd7e64982d92"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:07.629089 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:31:07.629089 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:31:07.637492 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-11b42e6a-f238-453a-89a6-55d350217a64 req-1a0ed5d9-3ca2-4c96-b457-34287657ecee service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:07.638377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-11b42e6a-f238-453a-89a6-55d350217a64 req-1a0ed5d9-3ca2-4c96-b457-34287657ecee service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:07.655799 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-11b42e6a-f238-453a-89a6-55d350217a64 req-1a0ed5d9-3ca2-4c96-b457-34287657ecee service nova] Creating event network-changed:4843d0bf-c438-4f38-b995-bd7e64982d92 for instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed on hv-cinder-82635 Jan 28 20:31:07.660697 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-11b42e6a-f238-453a-89a6-55d350217a64 req-1a0ed5d9-3ca2-4c96-b457-34287657ecee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040912 Jan 28 20:31:07.662279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 360/699] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:31:08.111708 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f34e342a-f70e-437f-89a7-d60d43e8f58c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:08.112294 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f34e342a-f70e-437f-89a7-d60d43e8f58c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:08.119062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34e342a-f70e-437f-89a7-d60d43e8f58c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.119511 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34e342a-f70e-437f-89a7-d60d43e8f58c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.120486 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34e342a-f70e-437f-89a7-d60d43e8f58c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.121076 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34e342a-f70e-437f-89a7-d60d43e8f58c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.148790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f34e342a-f70e-437f-89a7-d60d43e8f58c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:31:08.226916 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f34e342a-f70e-437f-89a7-d60d43e8f58c tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "DELETE /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 204 len: 0 microversion: 2.1 time: 0.118948 Jan 28 20:31:08.227751 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 340/700] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:31:08 2022] DELETE /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:31:08.236506 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-5bffa3dc-0ec4-497f-8650-8e024f7fad4d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:08.237187 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-5bffa3dc-0ec4-497f-8650-8e024f7fad4d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:08.243146 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5bffa3dc-0ec4-497f-8650-8e024f7fad4d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.243591 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5bffa3dc-0ec4-497f-8650-8e024f7fad4d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.244723 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5bffa3dc-0ec4-497f-8650-8e024f7fad4d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.245150 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5bffa3dc-0ec4-497f-8650-8e024f7fad4d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.249625 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-41bad7f1-0fc3-4d1b-9065-34b4bf2f609b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:08.250509 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-41bad7f1-0fc3-4d1b-9065-34b4bf2f609b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:08.258608 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41bad7f1-0fc3-4d1b-9065-34b4bf2f609b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.259153 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41bad7f1-0fc3-4d1b-9065-34b4bf2f609b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.259871 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41bad7f1-0fc3-4d1b-9065-34b4bf2f609b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.260307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-41bad7f1-0fc3-4d1b-9065-34b4bf2f609b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.463525 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-5bffa3dc-0ec4-497f-8650-8e024f7fad4d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:08.468241 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-41bad7f1-0fc3-4d1b-9065-34b4bf2f609b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:08.470976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-5bffa3dc-0ec4-497f-8650-8e024f7fad4d tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1514 microversion: 2.1 time: 0.238966 Jan 28 20:31:08.471562 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 361/701] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:08 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:08.476262 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-90567fa3-2ac9-4ac7-bd91-0e96b63bd3a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:08.477062 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-90567fa3-2ac9-4ac7-bd91-0e96b63bd3a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: 74ff9a8b-3bae-4ba8-b484-a534d77d5e43] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:08.479973 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-41bad7f1-0fc3-4d1b-9065-34b4bf2f609b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.234746 Jan 28 20:31:08.480585 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 341/702] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:08 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:08.485950 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:08.486625 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:08.488129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-90567fa3-2ac9-4ac7-bd91-0e96b63bd3a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.488676 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-90567fa3-2ac9-4ac7-bd91-0e96b63bd3a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.489533 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-90567fa3-2ac9-4ac7-bd91-0e96b63bd3a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.490119 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-90567fa3-2ac9-4ac7-bd91-0e96b63bd3a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.492350 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.492798 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.493576 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:08.494047 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:08.505110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-90567fa3-2ac9-4ac7-bd91-0e96b63bd3a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] HTTP exception thrown: Instance 74ff9a8b-3bae-4ba8-b484-a534d77d5e43 could not be found. Jan 28 20:31:08.505777 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-90567fa3-2ac9-4ac7-bd91-0e96b63bd3a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Returning 404 to user: Instance 74ff9a8b-3bae-4ba8-b484-a534d77d5e43 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:31:08.506691 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-90567fa3-2ac9-4ac7-bd91-0e96b63bd3a2 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43" status: 404 len: 111 microversion: 2.1 time: 0.034081 Jan 28 20:31:08.507302 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 362/703] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:08 2022] GET /compute/v2.1/servers/74ff9a8b-3bae-4ba8-b484-a534d77d5e43 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:31:08.646931 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:08.655517 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:08.657026 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:08.658145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5fd9bd6d-39c5-45f3-9a53-8ec190fe8e81 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.175696 Jan 28 20:31:08.658708 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 342/704] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:08 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:31:09.488041 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d9d9e52f-d0f1-4039-8916-a1dc567e4f45 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:09.488637 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d9d9e52f-d0f1-4039-8916-a1dc567e4f45 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:09.495019 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9d9e52f-d0f1-4039-8916-a1dc567e4f45 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.495466 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9d9e52f-d0f1-4039-8916-a1dc567e4f45 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.496066 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ad87f34a-0980-4506-9d89-8d1d7a3f3c36 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:09.496465 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9d9e52f-d0f1-4039-8916-a1dc567e4f45 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.496668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d9d9e52f-d0f1-4039-8916-a1dc567e4f45 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.496787 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ad87f34a-0980-4506-9d89-8d1d7a3f3c36 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:09.503318 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ad87f34a-0980-4506-9d89-8d1d7a3f3c36 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.503759 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ad87f34a-0980-4506-9d89-8d1d7a3f3c36 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.504532 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ad87f34a-0980-4506-9d89-8d1d7a3f3c36 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.504965 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ad87f34a-0980-4506-9d89-8d1d7a3f3c36 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.748416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ad87f34a-0980-4506-9d89-8d1d7a3f3c36 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:09.755186 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d9d9e52f-d0f1-4039-8916-a1dc567e4f45 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:09.755863 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ad87f34a-0980-4506-9d89-8d1d7a3f3c36 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.263322 Jan 28 20:31:09.756445 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 343/705] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:09 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:09.760810 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-52080a48-74c3-4154-90a1-fb7407fd5c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:09.761308 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-52080a48-74c3-4154-90a1-fb7407fd5c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:09.763521 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d9d9e52f-d0f1-4039-8916-a1dc567e4f45 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1514 microversion: 2.1 time: 0.278521 Jan 28 20:31:09.764084 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 363/706] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:09 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:09.767680 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-52080a48-74c3-4154-90a1-fb7407fd5c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.768222 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-52080a48-74c3-4154-90a1-fb7407fd5c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.768613 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-1212a875-379e-4198-95ba-4ecaaeffa2cc req-51502f6a-f96b-4644-a6ab-15d4b48b5b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ff9a8b-3bae-4ba8-b484-a534d77d5e43", "name": "network-vif-deleted", "tag": "ce9c009d-bd33-472f-8bed-913b4a444447"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:09.769146 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-52080a48-74c3-4154-90a1-fb7407fd5c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.769588 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-52080a48-74c3-4154-90a1-fb7407fd5c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.770163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:31:09.770163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:31:09.777296 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-1212a875-379e-4198-95ba-4ecaaeffa2cc req-51502f6a-f96b-4644-a6ab-15d4b48b5b6a service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.777758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-1212a875-379e-4198-95ba-4ecaaeffa2cc req-51502f6a-f96b-4644-a6ab-15d4b48b5b6a service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.791696 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-1212a875-379e-4198-95ba-4ecaaeffa2cc req-51502f6a-f96b-4644-a6ab-15d4b48b5b6a service nova] Creating event network-vif-deleted:ce9c009d-bd33-472f-8bed-913b4a444447 for instance 74ff9a8b-3bae-4ba8-b484-a534d77d5e43 on hv-cinder-82635 Jan 28 20:31:09.797072 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-1212a875-379e-4198-95ba-4ecaaeffa2cc req-51502f6a-f96b-4644-a6ab-15d4b48b5b6a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031611 Jan 28 20:31:09.797664 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 364/707] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:31:09.797761 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-52080a48-74c3-4154-90a1-fb7407fd5c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:31:09.802704 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:09.803385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:09.809189 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.810187 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.810962 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.811384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.875206 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-52080a48-74c3-4154-90a1-fb7407fd5c51 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 204 len: 0 microversion: 2.1 time: 0.117523 Jan 28 20:31:09.876185 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 344/708] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:31:09 2022] DELETE /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:31:09.884821 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d15c3b90-a1ea-4bad-9adf-a34de79a7f1d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:09.885512 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d15c3b90-a1ea-4bad-9adf-a34de79a7f1d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:09.891775 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d15c3b90-a1ea-4bad-9adf-a34de79a7f1d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.892225 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d15c3b90-a1ea-4bad-9adf-a34de79a7f1d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.893000 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d15c3b90-a1ea-4bad-9adf-a34de79a7f1d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:09.893430 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d15c3b90-a1ea-4bad-9adf-a34de79a7f1d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:09.980468 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:09.988460 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:09.990217 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:09.991324 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-975ccf13-0665-4b21-a822-cb89fe95a658 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.192578 Jan 28 20:31:09.991948 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 365/709] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:09 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:31:10.143689 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d15c3b90-a1ea-4bad-9adf-a34de79a7f1d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:10.151038 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d15c3b90-a1ea-4bad-9adf-a34de79a7f1d tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1513 microversion: 2.1 time: 0.270071 Jan 28 20:31:10.151602 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 345/710] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:09 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:10.779003 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-51bcd7dc-417b-4d07-8994-d30f12a2773d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:10.779612 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-51bcd7dc-417b-4d07-8994-d30f12a2773d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:10.780378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7f5ab97a-3cb5-46f8-9e47-5e0c77a72e96 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:10.781012 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7f5ab97a-3cb5-46f8-9e47-5e0c77a72e96 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:10.786079 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-51bcd7dc-417b-4d07-8994-d30f12a2773d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:10.786521 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-51bcd7dc-417b-4d07-8994-d30f12a2773d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:10.787237 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f5ab97a-3cb5-46f8-9e47-5e0c77a72e96 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:10.787351 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-51bcd7dc-417b-4d07-8994-d30f12a2773d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:10.787718 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-51bcd7dc-417b-4d07-8994-d30f12a2773d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:10.787868 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f5ab97a-3cb5-46f8-9e47-5e0c77a72e96 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:10.788610 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f5ab97a-3cb5-46f8-9e47-5e0c77a72e96 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:10.789040 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7f5ab97a-3cb5-46f8-9e47-5e0c77a72e96 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:10.982176 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7f5ab97a-3cb5-46f8-9e47-5e0c77a72e96 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:10.990437 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7f5ab97a-3cb5-46f8-9e47-5e0c77a72e96 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1514 microversion: 2.1 time: 0.213793 Jan 28 20:31:10.990985 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 346/711] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:10 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:10.994554 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-51bcd7dc-417b-4d07-8994-d30f12a2773d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:11.002807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-51bcd7dc-417b-4d07-8994-d30f12a2773d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.227586 Jan 28 20:31:11.003930 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 366/712] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:10 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:11.008121 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:11.008728 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:11.015434 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:11.015882 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:11.016662 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:11.017096 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:11.152383 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:11.160020 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:11.161607 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:11.162800 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8a2cd399-6778-4078-ad4f-7085f47bff9e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.158277 Jan 28 20:31:11.163585 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 347/713] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:11 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:31:11.178123 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e70ec8a3-fdd0-4fcf-9856-e68aeb8147e1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:11.178733 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e70ec8a3-fdd0-4fcf-9856-e68aeb8147e1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:11.185074 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e70ec8a3-fdd0-4fcf-9856-e68aeb8147e1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:11.185526 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e70ec8a3-fdd0-4fcf-9856-e68aeb8147e1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:11.186333 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e70ec8a3-fdd0-4fcf-9856-e68aeb8147e1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:11.186770 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e70ec8a3-fdd0-4fcf-9856-e68aeb8147e1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:11.324533 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e70ec8a3-fdd0-4fcf-9856-e68aeb8147e1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:11.332837 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e70ec8a3-fdd0-4fcf-9856-e68aeb8147e1 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1513 microversion: 2.1 time: 0.158208 Jan 28 20:31:11.333424 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 367/714] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:11 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:11.817861 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-0bef3b08-adb2-45c3-b342-7e76f53c5984 req-95411651-9446-4757-b786-0dabc44776d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363cf95b-1c28-42b0-8246-4cbff39ae4a8", "name": "network-vif-deleted", "tag": "5659c60c-97c6-4ce9-98c3-e9ec7e3a47df"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:11.819536 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:31:11.819536 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:31:11.828289 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-0bef3b08-adb2-45c3-b342-7e76f53c5984 req-95411651-9446-4757-b786-0dabc44776d3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:11.828737 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-0bef3b08-adb2-45c3-b342-7e76f53c5984 req-95411651-9446-4757-b786-0dabc44776d3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:11.839538 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-0bef3b08-adb2-45c3-b342-7e76f53c5984 req-95411651-9446-4757-b786-0dabc44776d3 service nova] Creating event network-vif-deleted:5659c60c-97c6-4ce9-98c3-e9ec7e3a47df for instance 363cf95b-1c28-42b0-8246-4cbff39ae4a8 on hv-cinder-82635 Jan 28 20:31:11.844260 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-0bef3b08-adb2-45c3-b342-7e76f53c5984 req-95411651-9446-4757-b786-0dabc44776d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036009 Jan 28 20:31:11.844864 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 348/715] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:31:11.860600 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-6aceeb4d-c656-4fb4-abc3-e93365b3a3df req-53668567-941f-4a42-b569-c7d8a521c64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc7cc38-742f-4269-8cb6-7cf3e97f1654", "name": "network-vif-plugged", "status": "completed", "tag": "2b3708de-bc79-4020-8e5f-b6aecdd43ef2"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:11.862228 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:31:11.862228 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:31:11.869818 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-6aceeb4d-c656-4fb4-abc3-e93365b3a3df req-53668567-941f-4a42-b569-c7d8a521c64a service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:11.870288 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-6aceeb4d-c656-4fb4-abc3-e93365b3a3df req-53668567-941f-4a42-b569-c7d8a521c64a service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:11.881686 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-6aceeb4d-c656-4fb4-abc3-e93365b3a3df req-53668567-941f-4a42-b569-c7d8a521c64a service nova] Creating event network-vif-plugged:2b3708de-bc79-4020-8e5f-b6aecdd43ef2 for instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 on hv-cinder-82635 Jan 28 20:31:11.886545 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-6aceeb4d-c656-4fb4-abc3-e93365b3a3df req-53668567-941f-4a42-b569-c7d8a521c64a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029691 Jan 28 20:31:11.887149 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 368/716] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:31:12.010309 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:12.011523 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:12.021501 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-22e780ef-bf9e-4cf4-b825-765b07d0da38 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:12.022657 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-22e780ef-bf9e-4cf4-b825-765b07d0da38 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:12.030163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-22e780ef-bf9e-4cf4-b825-765b07d0da38 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:12.031252 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-22e780ef-bf9e-4cf4-b825-765b07d0da38 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:12.032210 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-22e780ef-bf9e-4cf4-b825-765b07d0da38 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:12.032869 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-22e780ef-bf9e-4cf4-b825-765b07d0da38 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:12.036819 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:12.037286 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:12.050164 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:12.050748 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:12.096182 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:12.096878 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:12.097484 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lazy-loading 'fault' on Instance uuid 363cf95b-1c28-42b0-8246-4cbff39ae4a8 {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:31:12.156261 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912a6a973222441788982735658fabcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a5e26db5b844c4b585a7441fefd731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:12.162866 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dad17aaa-8960-4137-918f-ecefee366a76 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 200 len: 1308 microversion: 2.1 time: 0.158052 Jan 28 20:31:12.163435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 349/717] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:12 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:12.180521 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:12.181149 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:12.188228 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:12.188680 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:12.189602 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:12.190111 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:12.237921 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-22e780ef-bf9e-4cf4-b825-765b07d0da38 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:12.245219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-22e780ef-bf9e-4cf4-b825-765b07d0da38 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.227641 Jan 28 20:31:12.245787 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 369/718] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:12 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:12.324198 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:12.332339 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:12.333827 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:12.334943 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dcaaa2aa-8324-48a2-a520-f59e42c93101 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.158051 Jan 28 20:31:12.335497 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 350/719] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:12 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:31:12.349493 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4547fc54-279f-4c79-95d0-d8d8701f6c00 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:12.350123 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4547fc54-279f-4c79-95d0-d8d8701f6c00 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:12.355785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4547fc54-279f-4c79-95d0-d8d8701f6c00 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:12.356228 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4547fc54-279f-4c79-95d0-d8d8701f6c00 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:12.357088 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4547fc54-279f-4c79-95d0-d8d8701f6c00 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:12.357515 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4547fc54-279f-4c79-95d0-d8d8701f6c00 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:12.492009 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4547fc54-279f-4c79-95d0-d8d8701f6c00 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588b4e7353d2411ca853605fa586c8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73cfa908e094fa0b8fbc1e550e29d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:12.500001 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4547fc54-279f-4c79-95d0-d8d8701f6c00 tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 200 len: 1513 microversion: 2.1 time: 0.154067 Jan 28 20:31:12.500797 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 370/720] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:12 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:13.180341 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-48a3f66e-6c3c-408a-a16f-3e078ca02160 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:13.180855 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-48a3f66e-6c3c-408a-a16f-3e078ca02160 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] [instance: 363cf95b-1c28-42b0-8246-4cbff39ae4a8] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:13.187693 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-48a3f66e-6c3c-408a-a16f-3e078ca02160 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:13.188142 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-48a3f66e-6c3c-408a-a16f-3e078ca02160 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:13.188907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-48a3f66e-6c3c-408a-a16f-3e078ca02160 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:13.189339 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-48a3f66e-6c3c-408a-a16f-3e078ca02160 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:13.202579 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-48a3f66e-6c3c-408a-a16f-3e078ca02160 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] HTTP exception thrown: Instance 363cf95b-1c28-42b0-8246-4cbff39ae4a8 could not be found. Jan 28 20:31:13.203146 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-48a3f66e-6c3c-408a-a16f-3e078ca02160 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] Returning 404 to user: Instance 363cf95b-1c28-42b0-8246-4cbff39ae4a8 could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:31:13.203949 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-48a3f66e-6c3c-408a-a16f-3e078ca02160 tempest-VolumesSnapshotTestJSON-1770443698 tempest-VolumesSnapshotTestJSON-1770443698-project] 10.222.0.59 "GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8" status: 404 len: 111 microversion: 2.1 time: 0.027405 Jan 28 20:31:13.204461 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 351/721] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:13 2022] GET /compute/v2.1/servers/363cf95b-1c28-42b0-8246-4cbff39ae4a8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:31:13.261433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-00ead763-788d-46db-87db-83d46b3ca37a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:13.262206 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-00ead763-788d-46db-87db-83d46b3ca37a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:13.269159 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-00ead763-788d-46db-87db-83d46b3ca37a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:13.269632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-00ead763-788d-46db-87db-83d46b3ca37a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:13.270472 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-00ead763-788d-46db-87db-83d46b3ca37a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:13.270904 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-00ead763-788d-46db-87db-83d46b3ca37a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:13.354037 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:13.354766 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:13.363559 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:13.366820 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:13.373544 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:13.375601 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:13.533345 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-00ead763-788d-46db-87db-83d46b3ca37a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:13.551768 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-00ead763-788d-46db-87db-83d46b3ca37a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.293520 Jan 28 20:31:13.553525 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 371/722] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:13 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:13.565739 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-abb6d630-5e63-4d6f-b942-92c563945d5e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:13.567856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-abb6d630-5e63-4d6f-b942-92c563945d5e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] [instance: bf9d2426-a27b-4214-b459-f1431e8cd865] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:13.577377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-abb6d630-5e63-4d6f-b942-92c563945d5e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:13.578183 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-abb6d630-5e63-4d6f-b942-92c563945d5e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:13.579597 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-abb6d630-5e63-4d6f-b942-92c563945d5e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:13.581669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-abb6d630-5e63-4d6f-b942-92c563945d5e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:13.604131 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-abb6d630-5e63-4d6f-b942-92c563945d5e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] HTTP exception thrown: Instance bf9d2426-a27b-4214-b459-f1431e8cd865 could not be found. Jan 28 20:31:13.604723 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-abb6d630-5e63-4d6f-b942-92c563945d5e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] Returning 404 to user: Instance bf9d2426-a27b-4214-b459-f1431e8cd865 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:31:13.607544 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-abb6d630-5e63-4d6f-b942-92c563945d5e tempest-AttachVolumeNegativeTest-743533093 tempest-AttachVolumeNegativeTest-743533093-project] 10.222.0.59 "GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865" status: 404 len: 111 microversion: 2.1 time: 0.052206 Jan 28 20:31:13.608404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 372/723] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:13 2022] GET /compute/v2.1/servers/bf9d2426-a27b-4214-b459-f1431e8cd865 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:31:13.613573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:13.625155 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:13.626905 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:13.628013 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a92cce6f-c58f-49fd-bc8d-7d074ed76f9a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1405 microversion: 2.20 time: 0.278920 Jan 28 20:31:13.628724 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 352/724] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:13 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1405 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:31:13.858615 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-98df0737-4a44-473a-99fc-f38ebff10952 req-92c09bf3-bd15-41b4-93b9-053ab38152e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9d2426-a27b-4214-b459-f1431e8cd865", "name": "network-vif-deleted", "tag": "a7431330-e930-49ae-b76c-bf203d204d59"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:13.860163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:31:13.860163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:31:13.867425 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-98df0737-4a44-473a-99fc-f38ebff10952 req-92c09bf3-bd15-41b4-93b9-053ab38152e4 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:13.867912 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-98df0737-4a44-473a-99fc-f38ebff10952 req-92c09bf3-bd15-41b4-93b9-053ab38152e4 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:13.879783 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-98df0737-4a44-473a-99fc-f38ebff10952 req-92c09bf3-bd15-41b4-93b9-053ab38152e4 service nova] Creating event network-vif-deleted:a7431330-e930-49ae-b76c-bf203d204d59 for instance bf9d2426-a27b-4214-b459-f1431e8cd865 on hv-cinder-82635 Jan 28 20:31:13.885677 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-98df0737-4a44-473a-99fc-f38ebff10952 req-92c09bf3-bd15-41b4-93b9-053ab38152e4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031394 Jan 28 20:31:13.886634 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 373/725] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:31:14.569207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c7726dde-b143-4da0-a3d8-d7a0d31e1810 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:14.570601 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c7726dde-b143-4da0-a3d8-d7a0d31e1810 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:14.576899 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7726dde-b143-4da0-a3d8-d7a0d31e1810 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:14.577349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7726dde-b143-4da0-a3d8-d7a0d31e1810 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:14.578162 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7726dde-b143-4da0-a3d8-d7a0d31e1810 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:14.578600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7726dde-b143-4da0-a3d8-d7a0d31e1810 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:14.648682 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:14.651791 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:14.660865 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:14.662801 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:14.663954 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:14.664549 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:14.777111 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c7726dde-b143-4da0-a3d8-d7a0d31e1810 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:14.789991 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c7726dde-b143-4da0-a3d8-d7a0d31e1810 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.224180 Jan 28 20:31:14.792892 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 353/726] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:14 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:14.858074 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:14.866035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:14.867532 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:14.868933 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-232eeb8a-7b60-45bf-aa9b-a555c0275525 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1597 microversion: 2.20 time: 0.225735 Jan 28 20:31:14.870109 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 374/727] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:31:14 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1597 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:31:14.886564 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-16ba7cfe-44a4-4a01-9ff1-8a66879016aa tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:14.887052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-16ba7cfe-44a4-4a01-9ff1-8a66879016aa tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:14.893634 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-16ba7cfe-44a4-4a01-9ff1-8a66879016aa tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:14.894125 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-16ba7cfe-44a4-4a01-9ff1-8a66879016aa tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:14.894909 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-16ba7cfe-44a4-4a01-9ff1-8a66879016aa tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:14.895511 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-16ba7cfe-44a4-4a01-9ff1-8a66879016aa tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:14.977487 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-16ba7cfe-44a4-4a01-9ff1-8a66879016aa tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094984 Jan 28 20:31:14.978189 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 354/728] 10.222.0.59 () {60 vars in 1315 bytes} [Fri Jan 28 20:31:14 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:31:15.807515 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3b65f6ee-d3f4-4788-bcf6-997f5b7c4c67 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:15.808922 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3b65f6ee-d3f4-4788-bcf6-997f5b7c4c67 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:15.816994 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3b65f6ee-d3f4-4788-bcf6-997f5b7c4c67 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:15.817813 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3b65f6ee-d3f4-4788-bcf6-997f5b7c4c67 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:15.818844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3b65f6ee-d3f4-4788-bcf6-997f5b7c4c67 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:15.819476 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3b65f6ee-d3f4-4788-bcf6-997f5b7c4c67 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:15.939936 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-8c18675c-3dad-44bd-9550-ba8f8efedacf req-575ebee2-5d5f-4f81-bbbc-c5559394ccea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c701840-780a-4c1e-83e3-d03c2b53b0ed", "name": "network-vif-plugged", "status": "completed", "tag": "4843d0bf-c438-4f38-b995-bd7e64982d92"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:15.944498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:31:15.944498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:31:15.958597 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-8c18675c-3dad-44bd-9550-ba8f8efedacf req-575ebee2-5d5f-4f81-bbbc-c5559394ccea service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:15.961601 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-8c18675c-3dad-44bd-9550-ba8f8efedacf req-575ebee2-5d5f-4f81-bbbc-c5559394ccea service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:15.982953 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-8c18675c-3dad-44bd-9550-ba8f8efedacf req-575ebee2-5d5f-4f81-bbbc-c5559394ccea service nova] Creating event network-vif-plugged:4843d0bf-c438-4f38-b995-bd7e64982d92 for instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed on hv-cinder-82635 Jan 28 20:31:15.994194 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-8c18675c-3dad-44bd-9550-ba8f8efedacf req-575ebee2-5d5f-4f81-bbbc-c5559394ccea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062612 Jan 28 20:31:15.996080 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 355/729] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:31:16.241512 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3b65f6ee-d3f4-4788-bcf6-997f5b7c4c67 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:16.249042 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3b65f6ee-d3f4-4788-bcf6-997f5b7c4c67 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.445220 Jan 28 20:31:16.249611 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 375/730] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:15 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:16.295965 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-897ad5f9-d37f-44b4-b347-d8f97ad97554 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:16.296585 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-897ad5f9-d37f-44b4-b347-d8f97ad97554 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:16.299152 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-5c686525-1acb-43ea-8b0b-50fbb7e368ce req-a841e7c4-6789-4da6-9e6b-d424e1f4680e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc7cc38-742f-4269-8cb6-7cf3e97f1654", "tag": "2b3708de-bc79-4020-8e5f-b6aecdd43ef2"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:16.300949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:31:16.300949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:31:16.303056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-897ad5f9-d37f-44b4-b347-d8f97ad97554 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:16.303696 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-897ad5f9-d37f-44b4-b347-d8f97ad97554 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:16.304652 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-897ad5f9-d37f-44b4-b347-d8f97ad97554 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:16.305086 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-897ad5f9-d37f-44b4-b347-d8f97ad97554 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:16.307702 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-5c686525-1acb-43ea-8b0b-50fbb7e368ce req-a841e7c4-6789-4da6-9e6b-d424e1f4680e service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:16.308623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-5c686525-1acb-43ea-8b0b-50fbb7e368ce req-a841e7c4-6789-4da6-9e6b-d424e1f4680e service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:16.321831 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-5c686525-1acb-43ea-8b0b-50fbb7e368ce req-a841e7c4-6789-4da6-9e6b-d424e1f4680e service nova] Creating event network-changed:2b3708de-bc79-4020-8e5f-b6aecdd43ef2 for instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 on hv-cinder-82635 Jan 28 20:31:16.327357 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-5c686525-1acb-43ea-8b0b-50fbb7e368ce req-a841e7c4-6789-4da6-9e6b-d424e1f4680e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033215 Jan 28 20:31:16.327961 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 376/731] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:31:16.330758 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-897ad5f9-d37f-44b4-b347-d8f97ad97554 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/ips" status: 200 len: 112 microversion: 2.20 time: 0.038806 Jan 28 20:31:16.336137 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 356/732] 10.222.0.59 () {60 vars in 1288 bytes} [Fri Jan 28 20:31:16 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/ips => generated 112 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:31:17.271237 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d85ac3e6-d2e0-434b-bdef-1dce9e86e9a9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:17.271947 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d85ac3e6-d2e0-434b-bdef-1dce9e86e9a9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:17.278416 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d85ac3e6-d2e0-434b-bdef-1dce9e86e9a9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:17.278885 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d85ac3e6-d2e0-434b-bdef-1dce9e86e9a9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:17.283470 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d85ac3e6-d2e0-434b-bdef-1dce9e86e9a9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:17.283998 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d85ac3e6-d2e0-434b-bdef-1dce9e86e9a9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:17.447149 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d85ac3e6-d2e0-434b-bdef-1dce9e86e9a9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:17.454934 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d85ac3e6-d2e0-434b-bdef-1dce9e86e9a9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.191276 Jan 28 20:31:17.455769 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 377/733] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:17 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:18.171640 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:31:18.172207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: Fri Jan 28 20:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:31:18.471502 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c7838b82-436d-4377-af35-5eea04fdfba4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:18.472100 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c7838b82-436d-4377-af35-5eea04fdfba4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:18.478924 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7838b82-436d-4377-af35-5eea04fdfba4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:18.479487 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7838b82-436d-4377-af35-5eea04fdfba4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:18.480440 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7838b82-436d-4377-af35-5eea04fdfba4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:18.480972 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c7838b82-436d-4377-af35-5eea04fdfba4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:18.610196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c7838b82-436d-4377-af35-5eea04fdfba4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:18.617287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c7838b82-436d-4377-af35-5eea04fdfba4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.149402 Jan 28 20:31:18.617846 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 357/734] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:18 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:19.635759 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3d55cd94-26ee-4733-a05e-fcc686d56202 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:19.636353 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3d55cd94-26ee-4733-a05e-fcc686d56202 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:19.643101 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3d55cd94-26ee-4733-a05e-fcc686d56202 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:19.643552 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3d55cd94-26ee-4733-a05e-fcc686d56202 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:19.644334 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3d55cd94-26ee-4733-a05e-fcc686d56202 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:19.644764 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3d55cd94-26ee-4733-a05e-fcc686d56202 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:19.790014 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3d55cd94-26ee-4733-a05e-fcc686d56202 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:19.798630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3d55cd94-26ee-4733-a05e-fcc686d56202 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.166498 Jan 28 20:31:19.799358 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 378/735] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:19 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:20.815821 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dc2ad332-9c28-42db-9b30-eaa16a0ba975 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:20.816530 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dc2ad332-9c28-42db-9b30-eaa16a0ba975 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:20.822609 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc2ad332-9c28-42db-9b30-eaa16a0ba975 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:20.823053 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc2ad332-9c28-42db-9b30-eaa16a0ba975 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:20.823823 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc2ad332-9c28-42db-9b30-eaa16a0ba975 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:20.824251 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc2ad332-9c28-42db-9b30-eaa16a0ba975 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:20.965010 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dc2ad332-9c28-42db-9b30-eaa16a0ba975 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:20.974462 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dc2ad332-9c28-42db-9b30-eaa16a0ba975 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.162337 Jan 28 20:31:20.975042 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 358/736] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:20 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:21.991844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d8380b11-ed29-4950-8321-b3e624596ddb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:21.992441 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d8380b11-ed29-4950-8321-b3e624596ddb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:21.999327 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d8380b11-ed29-4950-8321-b3e624596ddb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:21.999711 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d8380b11-ed29-4950-8321-b3e624596ddb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:22.000472 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d8380b11-ed29-4950-8321-b3e624596ddb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:22.000899 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d8380b11-ed29-4950-8321-b3e624596ddb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:22.132836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d8380b11-ed29-4950-8321-b3e624596ddb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:22.139966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d8380b11-ed29-4950-8321-b3e624596ddb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.151851 Jan 28 20:31:22.140526 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 379/737] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:21 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:23.156893 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9261d8ae-7db3-47c9-8e8e-70d87327336a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:23.157516 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9261d8ae-7db3-47c9-8e8e-70d87327336a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:23.163752 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9261d8ae-7db3-47c9-8e8e-70d87327336a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:23.164196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9261d8ae-7db3-47c9-8e8e-70d87327336a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:23.164971 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9261d8ae-7db3-47c9-8e8e-70d87327336a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:23.165401 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9261d8ae-7db3-47c9-8e8e-70d87327336a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:23.302327 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9261d8ae-7db3-47c9-8e8e-70d87327336a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:23.310010 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9261d8ae-7db3-47c9-8e8e-70d87327336a tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.156640 Jan 28 20:31:23.310573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 359/738] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:23 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:31:24.326759 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-fc062e36-17ca-46f3-84cd-1be818c1971e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:24.327320 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-fc062e36-17ca-46f3-84cd-1be818c1971e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:24.333505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc062e36-17ca-46f3-84cd-1be818c1971e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:24.333987 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc062e36-17ca-46f3-84cd-1be818c1971e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:24.334765 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc062e36-17ca-46f3-84cd-1be818c1971e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:24.335192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-fc062e36-17ca-46f3-84cd-1be818c1971e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:24.464020 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-fc062e36-17ca-46f3-84cd-1be818c1971e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:24.471332 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-fc062e36-17ca-46f3-84cd-1be818c1971e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.148780 Jan 28 20:31:24.471894 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 380/739] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:24 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:25.487376 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4ef7b982-072a-4b7f-ba4a-023f2a143932 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:25.487987 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4ef7b982-072a-4b7f-ba4a-023f2a143932 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:25.494170 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4ef7b982-072a-4b7f-ba4a-023f2a143932 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:25.494616 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4ef7b982-072a-4b7f-ba4a-023f2a143932 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:25.495391 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4ef7b982-072a-4b7f-ba4a-023f2a143932 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:25.495821 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4ef7b982-072a-4b7f-ba4a-023f2a143932 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:25.645351 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4ef7b982-072a-4b7f-ba4a-023f2a143932 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:25.653221 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4ef7b982-072a-4b7f-ba4a-023f2a143932 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1363 microversion: 2.1 time: 0.169337 Jan 28 20:31:25.653902 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 360/740] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:25 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:26.669153 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-66b94d2d-424c-402d-a441-f4c37e4cfde5 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:26.669761 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-66b94d2d-424c-402d-a441-f4c37e4cfde5 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:26.675997 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-66b94d2d-424c-402d-a441-f4c37e4cfde5 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:26.676447 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-66b94d2d-424c-402d-a441-f4c37e4cfde5 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:26.677225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-66b94d2d-424c-402d-a441-f4c37e4cfde5 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:26.677661 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-66b94d2d-424c-402d-a441-f4c37e4cfde5 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:26.812146 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-66b94d2d-424c-402d-a441-f4c37e4cfde5 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:31:26.819558 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-66b94d2d-424c-402d-a441-f4c37e4cfde5 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1550 microversion: 2.1 time: 0.153912 Jan 28 20:31:26.820094 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 381/741] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:31:26 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:31:26.835722 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dc4ceb9f-5ec5-406a-81ec-21f620a1c31c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:26.836260 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dc4ceb9f-5ec5-406a-81ec-21f620a1c31c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:26.842530 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc4ceb9f-5ec5-406a-81ec-21f620a1c31c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:26.846012 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc4ceb9f-5ec5-406a-81ec-21f620a1c31c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:26.846012 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc4ceb9f-5ec5-406a-81ec-21f620a1c31c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:26.846012 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc4ceb9f-5ec5-406a-81ec-21f620a1c31c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:26.935848 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dc4ceb9f-5ec5-406a-81ec-21f620a1c31c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103645 Jan 28 20:31:26.936437 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 361/742] 10.222.0.59 () {58 vars in 1274 bytes} [Fri Jan 28 20:31:26 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:31:27.917900 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-2d2f4f72-6157-4b30-81c4-83e48938155d req-ad47a088-8102-4969-8245-25554ac30f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c701840-780a-4c1e-83e3-d03c2b53b0ed", "tag": "4843d0bf-c438-4f38-b995-bd7e64982d92"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:31:27.923069 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ac66b6c3-5f2d-457a-85cd-7866dd622bea tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:31:27.923610 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ac66b6c3-5f2d-457a-85cd-7866dd622bea tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:31:27.925427 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:31:27.925427 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:31:27.935534 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ac66b6c3-5f2d-457a-85cd-7866dd622bea tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:27.936248 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ac66b6c3-5f2d-457a-85cd-7866dd622bea tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:27.947239 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ac66b6c3-5f2d-457a-85cd-7866dd622bea tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:27.947559 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-2d2f4f72-6157-4b30-81c4-83e48938155d req-ad47a088-8102-4969-8245-25554ac30f97 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:31:27.947559 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-2d2f4f72-6157-4b30-81c4-83e48938155d req-ad47a088-8102-4969-8245-25554ac30f97 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:27.947740 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ac66b6c3-5f2d-457a-85cd-7866dd622bea tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:31:27.950875 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-2d2f4f72-6157-4b30-81c4-83e48938155d req-ad47a088-8102-4969-8245-25554ac30f97 service nova] Creating event network-changed:4843d0bf-c438-4f38-b995-bd7e64982d92 for instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed on hv-cinder-82635 Jan 28 20:31:27.956472 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-2d2f4f72-6157-4b30-81c4-83e48938155d req-ad47a088-8102-4969-8245-25554ac30f97 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042499 Jan 28 20:31:27.957310 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 362/743] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:31:27.974675 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ac66b6c3-5f2d-457a-85cd-7866dd622bea tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/ips" status: 200 len: 107 microversion: 2.1 time: 0.062741 Jan 28 20:31:27.975572 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 382/744] 10.222.0.59 () {58 vars in 1247 bytes} [Fri Jan 28 20:31:27 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/ips => generated 107 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:32:46.000941 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bf5aa8f2-1997-4b69-b6c0-a1b5c676d493] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 28 20:32:46.005180 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2eaccf69-416d-4e9c-968c-0794b4aaf984 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Action: 'create', calling method: .version_select at 0x7fc7796d23a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1502555881"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:32:46.019219 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-2eaccf69-416d-4e9c-968c-0794b4aaf984 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Getting quotas for project 6c3f2930540d4043b25e26a37f8a0a25. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:32:46.022899 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-2eaccf69-416d-4e9c-968c-0794b4aaf984 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Getting quotas for user 1834cf2d5ad64dec8602c45323f20d70 and project 6c3f2930540d4043b25e26a37f8a0a25. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:32:46.159772 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-2eaccf69-416d-4e9c-968c-0794b4aaf984 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Getting quotas for project 6c3f2930540d4043b25e26a37f8a0a25. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:32:46.163335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-2eaccf69-416d-4e9c-968c-0794b4aaf984 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Getting quotas for user 1834cf2d5ad64dec8602c45323f20d70 and project 6c3f2930540d4043b25e26a37f8a0a25. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:32:46.175672 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2eaccf69-416d-4e9c-968c-0794b4aaf984 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.176626 Jan 28 20:32:46.176258 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 363/745] 10.222.0.59 () {60 vars in 1157 bytes} [Fri Jan 28 20:32:45 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:46.230557 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-799405912", "imageRef": "e90c1372-caf5-4ea4-82da-5a8e86dd4696", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1502555881", "networks": [{"uuid": "8262c78b-9cc8-436b-9e71-59dcb58b33e8"}]}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:32:46.279407 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] validate_networks() for [('8262c78b-9cc8-436b-9e71-59dcb58b33e8', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:32:46.739668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:32:46.740090 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:32:46.740559 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:32:46.740962 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:32:46.741368 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:32:46.749794 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:46.750266 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:46.751080 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:46.751516 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:46.767953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Getting quotas for project 6c3f2930540d4043b25e26a37f8a0a25. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:32:46.771781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Getting quotas for user 1834cf2d5ad64dec8602c45323f20d70 and project 6c3f2930540d4043b25e26a37f8a0a25. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:32:46.782949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:32:46.785130 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e90c1372-caf5-4ea4-82da-5a8e86dd4696',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:32:46.831500 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-5b37c8df-9d47-4450-96d7-ab1146c3001a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606164 Jan 28 20:32:46.832332 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 383/746] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:32:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:32:46.841660 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-564a11b4-257e-4420-8aa8-d7feb486966e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:46.842425 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-564a11b4-257e-4420-8aa8-d7feb486966e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:46.898313 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-564a11b4-257e-4420-8aa8-d7feb486966e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:46.905583 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-564a11b4-257e-4420-8aa8-d7feb486966e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1258 microversion: 2.1 time: 0.067521 Jan 28 20:32:46.906193 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 364/747] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:46 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:47.927489 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-31420568-3c14-43f2-9415-24db323bc201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:47.928030 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-31420568-3c14-43f2-9415-24db323bc201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:47.934675 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-31420568-3c14-43f2-9415-24db323bc201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:47.935117 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-31420568-3c14-43f2-9415-24db323bc201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:47.935891 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-31420568-3c14-43f2-9415-24db323bc201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:47.936480 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-31420568-3c14-43f2-9415-24db323bc201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:47.999391 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-31420568-3c14-43f2-9415-24db323bc201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:48.009595 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-31420568-3c14-43f2-9415-24db323bc201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1328 microversion: 2.1 time: 0.085844 Jan 28 20:32:48.010269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 384/748] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:47 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1328 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:49.027146 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-534f0d6f-fc79-4a7d-92d3-84b80c290a7e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:49.027770 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-534f0d6f-fc79-4a7d-92d3-84b80c290a7e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:49.045497 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO oslo.messaging._drivers.impl_rabbit [-] [bf5aa8f2-1997-4b69-b6c0-a1b5c676d493] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 40496. Jan 28 20:32:49.049810 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-534f0d6f-fc79-4a7d-92d3-84b80c290a7e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:49.050304 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-534f0d6f-fc79-4a7d-92d3-84b80c290a7e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:49.051436 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-534f0d6f-fc79-4a7d-92d3-84b80c290a7e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:49.051877 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-534f0d6f-fc79-4a7d-92d3-84b80c290a7e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:49.195669 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-534f0d6f-fc79-4a7d-92d3-84b80c290a7e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:49.203701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-534f0d6f-fc79-4a7d-92d3-84b80c290a7e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.180549 Jan 28 20:32:49.204277 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 365/749] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:49 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:50.220516 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bfb9e788-9b68-4d5f-87d6-b6dc0011db15 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:50.221772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bfb9e788-9b68-4d5f-87d6-b6dc0011db15 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:50.229088 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bfb9e788-9b68-4d5f-87d6-b6dc0011db15 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:50.229534 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bfb9e788-9b68-4d5f-87d6-b6dc0011db15 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:50.230346 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bfb9e788-9b68-4d5f-87d6-b6dc0011db15 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:50.230777 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bfb9e788-9b68-4d5f-87d6-b6dc0011db15 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:50.366871 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bfb9e788-9b68-4d5f-87d6-b6dc0011db15 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:50.374015 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bfb9e788-9b68-4d5f-87d6-b6dc0011db15 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.157326 Jan 28 20:32:50.374587 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 385/750] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:50 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:51.391240 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5f073843-a016-4540-8377-c05773e6636a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:51.391860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5f073843-a016-4540-8377-c05773e6636a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:51.398249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5f073843-a016-4540-8377-c05773e6636a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:51.398969 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5f073843-a016-4540-8377-c05773e6636a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:51.400249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5f073843-a016-4540-8377-c05773e6636a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:51.400859 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5f073843-a016-4540-8377-c05773e6636a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:51.541804 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5f073843-a016-4540-8377-c05773e6636a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:51.548962 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5f073843-a016-4540-8377-c05773e6636a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.161413 Jan 28 20:32:51.549532 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 366/751] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:51 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:52.565283 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-787818db-8a00-473d-a9ca-17da9f91d602 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:52.565930 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-787818db-8a00-473d-a9ca-17da9f91d602 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:52.572263 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-787818db-8a00-473d-a9ca-17da9f91d602 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:52.572737 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-787818db-8a00-473d-a9ca-17da9f91d602 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:52.573525 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-787818db-8a00-473d-a9ca-17da9f91d602 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:52.573989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-787818db-8a00-473d-a9ca-17da9f91d602 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:52.717508 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-787818db-8a00-473d-a9ca-17da9f91d602 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:52.725736 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-787818db-8a00-473d-a9ca-17da9f91d602 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.163938 Jan 28 20:32:52.731693 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 386/752] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:52 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:53.742866 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1e721170-4262-49f1-9026-f3626397e8d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:53.743616 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1e721170-4262-49f1-9026-f3626397e8d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:53.749883 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1e721170-4262-49f1-9026-f3626397e8d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:53.750335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1e721170-4262-49f1-9026-f3626397e8d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:53.751106 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1e721170-4262-49f1-9026-f3626397e8d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:53.751534 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1e721170-4262-49f1-9026-f3626397e8d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:53.887450 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1e721170-4262-49f1-9026-f3626397e8d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:53.894927 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1e721170-4262-49f1-9026-f3626397e8d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.155624 Jan 28 20:32:53.905023 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 367/753] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:53 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:54.912122 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-866d7e18-a0ee-4cfe-bb80-e0dfed9bbf70 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:54.912850 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-866d7e18-a0ee-4cfe-bb80-e0dfed9bbf70 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:54.920216 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-866d7e18-a0ee-4cfe-bb80-e0dfed9bbf70 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:54.920665 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-866d7e18-a0ee-4cfe-bb80-e0dfed9bbf70 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:54.921455 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-866d7e18-a0ee-4cfe-bb80-e0dfed9bbf70 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:54.921906 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-866d7e18-a0ee-4cfe-bb80-e0dfed9bbf70 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:55.071054 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-866d7e18-a0ee-4cfe-bb80-e0dfed9bbf70 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:55.078642 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-866d7e18-a0ee-4cfe-bb80-e0dfed9bbf70 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.170017 Jan 28 20:32:55.079361 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 387/754] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:54 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:56.095814 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a86073ab-fe24-49fd-adf2-952d125c74b8 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:56.096416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a86073ab-fe24-49fd-adf2-952d125c74b8 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:56.102453 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a86073ab-fe24-49fd-adf2-952d125c74b8 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:56.103467 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a86073ab-fe24-49fd-adf2-952d125c74b8 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:56.104263 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a86073ab-fe24-49fd-adf2-952d125c74b8 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:56.104880 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a86073ab-fe24-49fd-adf2-952d125c74b8 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:56.239636 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a86073ab-fe24-49fd-adf2-952d125c74b8 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:56.247206 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a86073ab-fe24-49fd-adf2-952d125c74b8 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.155112 Jan 28 20:32:56.247992 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 368/755] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:56 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:57.264085 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d66dad3c-3136-479c-8e25-b69d2e335360 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:57.264640 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d66dad3c-3136-479c-8e25-b69d2e335360 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:57.270864 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d66dad3c-3136-479c-8e25-b69d2e335360 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:57.271305 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d66dad3c-3136-479c-8e25-b69d2e335360 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:57.272078 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d66dad3c-3136-479c-8e25-b69d2e335360 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:57.272502 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d66dad3c-3136-479c-8e25-b69d2e335360 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:57.407188 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d66dad3c-3136-479c-8e25-b69d2e335360 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:57.414482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d66dad3c-3136-479c-8e25-b69d2e335360 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.154091 Jan 28 20:32:57.415048 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 388/756] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:57 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:58.441442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-58ceb61c-e049-4217-91f2-a84d20d5d205 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:58.449154 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-58ceb61c-e049-4217-91f2-a84d20d5d205 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:58.467683 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-58ceb61c-e049-4217-91f2-a84d20d5d205 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:58.468143 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-58ceb61c-e049-4217-91f2-a84d20d5d205 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:58.468944 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-58ceb61c-e049-4217-91f2-a84d20d5d205 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:58.469378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-58ceb61c-e049-4217-91f2-a84d20d5d205 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:58.608101 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-58ceb61c-e049-4217-91f2-a84d20d5d205 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:58.615508 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-58ceb61c-e049-4217-91f2-a84d20d5d205 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.186794 Jan 28 20:32:58.616077 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 369/757] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:58 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:32:59.632368 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ad00705b-1fe9-440c-8c62-fcc44c2f3cbb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:32:59.632973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ad00705b-1fe9-440c-8c62-fcc44c2f3cbb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:32:59.639304 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ad00705b-1fe9-440c-8c62-fcc44c2f3cbb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:59.639745 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ad00705b-1fe9-440c-8c62-fcc44c2f3cbb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:59.640514 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ad00705b-1fe9-440c-8c62-fcc44c2f3cbb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:32:59.640941 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ad00705b-1fe9-440c-8c62-fcc44c2f3cbb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:32:59.774987 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ad00705b-1fe9-440c-8c62-fcc44c2f3cbb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:32:59.782088 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ad00705b-1fe9-440c-8c62-fcc44c2f3cbb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.153744 Jan 28 20:32:59.782661 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 389/758] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:32:59 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:00.798779 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9778c883-9aee-46bc-b8fd-88c77804d45c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:00.799470 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9778c883-9aee-46bc-b8fd-88c77804d45c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:00.806238 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9778c883-9aee-46bc-b8fd-88c77804d45c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:00.806685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9778c883-9aee-46bc-b8fd-88c77804d45c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:00.807457 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9778c883-9aee-46bc-b8fd-88c77804d45c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:00.807889 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9778c883-9aee-46bc-b8fd-88c77804d45c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:00.940346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9778c883-9aee-46bc-b8fd-88c77804d45c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:00.947489 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9778c883-9aee-46bc-b8fd-88c77804d45c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.152415 Jan 28 20:33:00.948047 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 370/759] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:00 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:01.966521 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e3859f0e-231a-4052-9f0f-54bfe11100e5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:01.968325 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e3859f0e-231a-4052-9f0f-54bfe11100e5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:01.982178 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e3859f0e-231a-4052-9f0f-54bfe11100e5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:01.983692 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e3859f0e-231a-4052-9f0f-54bfe11100e5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:01.991063 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e3859f0e-231a-4052-9f0f-54bfe11100e5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:01.992469 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e3859f0e-231a-4052-9f0f-54bfe11100e5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:02.089246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-9a5b7159-5f18-4406-b2e0-bf72b44dca58 req-91b10698-92a0-48b8-b237-74c897f3d5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16081702-e065-419c-bb8c-8bb4ee6a7470", "tag": "93c9ee57-f372-42ef-bca7-ac691fd1d6e3"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:02.092192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:33:02.092192 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:33:02.101264 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-9a5b7159-5f18-4406-b2e0-bf72b44dca58 req-91b10698-92a0-48b8-b237-74c897f3d5e8 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:02.102227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-9a5b7159-5f18-4406-b2e0-bf72b44dca58 req-91b10698-92a0-48b8-b237-74c897f3d5e8 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:02.117030 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-9a5b7159-5f18-4406-b2e0-bf72b44dca58 req-91b10698-92a0-48b8-b237-74c897f3d5e8 service nova] Creating event network-changed:93c9ee57-f372-42ef-bca7-ac691fd1d6e3 for instance 16081702-e065-419c-bb8c-8bb4ee6a7470 on hv-cinder-82635 Jan 28 20:33:02.123673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-9a5b7159-5f18-4406-b2e0-bf72b44dca58 req-91b10698-92a0-48b8-b237-74c897f3d5e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213358 Jan 28 20:33:02.124303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 390/760] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:33:02.161022 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e3859f0e-231a-4052-9f0f-54bfe11100e5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:02.169506 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e3859f0e-231a-4052-9f0f-54bfe11100e5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.208791 Jan 28 20:33:02.170113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 371/761] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:01 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:33:03.187671 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7d39d9b5-ef1b-4e61-a75f-6c53ae530daa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:03.188377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7d39d9b5-ef1b-4e61-a75f-6c53ae530daa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:03.194403 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7d39d9b5-ef1b-4e61-a75f-6c53ae530daa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:03.194846 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7d39d9b5-ef1b-4e61-a75f-6c53ae530daa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:03.195603 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7d39d9b5-ef1b-4e61-a75f-6c53ae530daa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:03.196027 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7d39d9b5-ef1b-4e61-a75f-6c53ae530daa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:03.329712 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7d39d9b5-ef1b-4e61-a75f-6c53ae530daa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:03.336992 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7d39d9b5-ef1b-4e61-a75f-6c53ae530daa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.154316 Jan 28 20:33:03.337555 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 391/762] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:03 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:04.353348 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cf12b5c1-3b0b-46d5-8289-2e38f4b73206 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:04.353974 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cf12b5c1-3b0b-46d5-8289-2e38f4b73206 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:04.360429 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cf12b5c1-3b0b-46d5-8289-2e38f4b73206 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:04.361033 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cf12b5c1-3b0b-46d5-8289-2e38f4b73206 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:04.361995 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cf12b5c1-3b0b-46d5-8289-2e38f4b73206 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:04.362423 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cf12b5c1-3b0b-46d5-8289-2e38f4b73206 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:04.493229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-cf12b5c1-3b0b-46d5-8289-2e38f4b73206 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:04.500260 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cf12b5c1-3b0b-46d5-8289-2e38f4b73206 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.150574 Jan 28 20:33:04.500824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 372/763] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:04 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:05.517197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-971925b3-a002-4f96-bed9-72d0419170cc tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:05.517794 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-971925b3-a002-4f96-bed9-72d0419170cc tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:05.524414 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-971925b3-a002-4f96-bed9-72d0419170cc tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:05.524842 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-971925b3-a002-4f96-bed9-72d0419170cc tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:05.525640 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-971925b3-a002-4f96-bed9-72d0419170cc tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:05.526099 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-971925b3-a002-4f96-bed9-72d0419170cc tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:05.655751 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-971925b3-a002-4f96-bed9-72d0419170cc tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:05.662951 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-971925b3-a002-4f96-bed9-72d0419170cc tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.149374 Jan 28 20:33:05.663514 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 392/764] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:05 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:06.679675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-35d0e8cd-b8d2-474d-9193-95424f4a4859 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:06.680277 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-35d0e8cd-b8d2-474d-9193-95424f4a4859 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:06.686492 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-35d0e8cd-b8d2-474d-9193-95424f4a4859 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:06.686935 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-35d0e8cd-b8d2-474d-9193-95424f4a4859 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:06.687701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-35d0e8cd-b8d2-474d-9193-95424f4a4859 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:06.688128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-35d0e8cd-b8d2-474d-9193-95424f4a4859 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:06.821659 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-35d0e8cd-b8d2-474d-9193-95424f4a4859 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:06.830491 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-35d0e8cd-b8d2-474d-9193-95424f4a4859 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.154374 Jan 28 20:33:06.831061 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 373/765] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:06 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:06.844405 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-260b8839-eafc-44de-a356-c8dad8ab3eba tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:06.845344 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-260b8839-eafc-44de-a356-c8dad8ab3eba tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:06.851769 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-260b8839-eafc-44de-a356-c8dad8ab3eba tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:06.852851 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-260b8839-eafc-44de-a356-c8dad8ab3eba tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:06.853646 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-260b8839-eafc-44de-a356-c8dad8ab3eba tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:06.854093 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-260b8839-eafc-44de-a356-c8dad8ab3eba tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:06.876222 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-260b8839-eafc-44de-a356-c8dad8ab3eba tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lazy-loading 'flavor' on Instance uuid 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:33:07.129207 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-260b8839-eafc-44de-a356-c8dad8ab3eba tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "POST /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/action" status: 202 len: 0 microversion: 2.20 time: 0.288298 Jan 28 20:33:07.129822 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 393/766] 10.222.0.59 () {62 vars in 1318 bytes} [Fri Jan 28 20:33:06 2022] POST /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:33:07.138554 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:07.139171 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:07.145028 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:07.145613 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:07.146560 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:07.147123 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:07.285230 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:07.292936 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:07.294453 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:07.295597 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-04d5b12a-2fb3-4c20-b4d6-d499ecb70e33 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.160831 Jan 28 20:33:07.296153 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 374/767] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:07 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:07.847669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-80da980f-8f3e-47a7-8439-5d1b3f57928e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:07.848355 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-80da980f-8f3e-47a7-8439-5d1b3f57928e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:07.854819 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-80da980f-8f3e-47a7-8439-5d1b3f57928e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:07.855288 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-80da980f-8f3e-47a7-8439-5d1b3f57928e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:07.856057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-80da980f-8f3e-47a7-8439-5d1b3f57928e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:07.856480 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-80da980f-8f3e-47a7-8439-5d1b3f57928e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:07.988275 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-80da980f-8f3e-47a7-8439-5d1b3f57928e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:07.996694 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-80da980f-8f3e-47a7-8439-5d1b3f57928e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.152911 Jan 28 20:33:07.997276 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 394/768] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:07 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:08.313718 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:08.314457 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:08.320585 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:08.321059 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:08.321822 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:08.322273 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:08.457956 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:08.466120 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:08.467637 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:08.468774 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-feb61361-29a8-4690-bb1c-28938f75a9d7 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.158743 Jan 28 20:33:08.469335 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 375/769] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:08 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:08.580475 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-b71b5504-cd94-4f31-9120-a4e4990a6e83 req-9e3e5e57-b866-4771-8777-a4e9ff0f6422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16081702-e065-419c-bb8c-8bb4ee6a7470", "name": "network-vif-plugged", "status": "completed", "tag": "93c9ee57-f372-42ef-bca7-ac691fd1d6e3"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:08.582124 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:33:08.582124 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:33:08.589924 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-b71b5504-cd94-4f31-9120-a4e4990a6e83 req-9e3e5e57-b866-4771-8777-a4e9ff0f6422 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:08.590373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-b71b5504-cd94-4f31-9120-a4e4990a6e83 req-9e3e5e57-b866-4771-8777-a4e9ff0f6422 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:08.601448 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-b71b5504-cd94-4f31-9120-a4e4990a6e83 req-9e3e5e57-b866-4771-8777-a4e9ff0f6422 service nova] Creating event network-vif-plugged:93c9ee57-f372-42ef-bca7-ac691fd1d6e3 for instance 16081702-e065-419c-bb8c-8bb4ee6a7470 on hv-cinder-82635 Jan 28 20:33:08.606195 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-b71b5504-cd94-4f31-9120-a4e4990a6e83 req-9e3e5e57-b866-4771-8777-a4e9ff0f6422 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083942 Jan 28 20:33:08.606950 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 395/770] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:33:09.012939 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-26d7fe32-7b84-4210-bcc1-3900d23c3a9b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:09.013573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-26d7fe32-7b84-4210-bcc1-3900d23c3a9b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:09.019379 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-26d7fe32-7b84-4210-bcc1-3900d23c3a9b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:09.019824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-26d7fe32-7b84-4210-bcc1-3900d23c3a9b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:09.020601 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-26d7fe32-7b84-4210-bcc1-3900d23c3a9b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:09.021035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-26d7fe32-7b84-4210-bcc1-3900d23c3a9b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:09.155351 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-26d7fe32-7b84-4210-bcc1-3900d23c3a9b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:09.162470 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-26d7fe32-7b84-4210-bcc1-3900d23c3a9b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.153851 Jan 28 20:33:09.163038 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 376/771] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:09 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:09.486568 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:09.487258 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:09.494800 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:09.495240 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:09.496223 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:09.496644 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:09.631330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:09.639601 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:09.641094 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:09.642278 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c9f2e1fe-ef53-4388-bdfc-e1ea9cfc452c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.159681 Jan 28 20:33:09.642842 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 396/772] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:09 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:10.180090 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1cd42638-7b75-48f7-bbc5-6d1cdb05d664 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:10.181318 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1cd42638-7b75-48f7-bbc5-6d1cdb05d664 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:10.188061 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1cd42638-7b75-48f7-bbc5-6d1cdb05d664 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:10.188514 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1cd42638-7b75-48f7-bbc5-6d1cdb05d664 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:10.189300 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1cd42638-7b75-48f7-bbc5-6d1cdb05d664 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:10.189735 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1cd42638-7b75-48f7-bbc5-6d1cdb05d664 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:10.322703 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1cd42638-7b75-48f7-bbc5-6d1cdb05d664 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:10.330263 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1cd42638-7b75-48f7-bbc5-6d1cdb05d664 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1358 microversion: 2.1 time: 0.154168 Jan 28 20:33:10.330820 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 377/773] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:10 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:10.660190 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:10.660784 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:10.666974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:10.667408 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:10.668170 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:10.668592 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:10.800526 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:10.808345 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:10.809858 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:10.811023 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-04feb38e-fff9-4311-8ffc-c5be76579fd4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.154481 Jan 28 20:33:10.811584 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 397/774] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:10 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:11.348019 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-20b95270-b264-4f6b-bca2-2e33341b34ee tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:11.348587 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-20b95270-b264-4f6b-bca2-2e33341b34ee tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:11.354681 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20b95270-b264-4f6b-bca2-2e33341b34ee tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.355121 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20b95270-b264-4f6b-bca2-2e33341b34ee tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:11.355886 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20b95270-b264-4f6b-bca2-2e33341b34ee tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.356313 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20b95270-b264-4f6b-bca2-2e33341b34ee tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:11.486999 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-20b95270-b264-4f6b-bca2-2e33341b34ee tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:11.494799 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-20b95270-b264-4f6b-bca2-2e33341b34ee tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1549 microversion: 2.1 time: 0.150844 Jan 28 20:33:11.495421 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 378/775] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:11 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:11.510284 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-801c1d14-9db0-48e3-923d-2b4a144c4dfa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:11.510944 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-801c1d14-9db0-48e3-923d-2b4a144c4dfa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:11.516636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-801c1d14-9db0-48e3-923d-2b4a144c4dfa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.517083 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-801c1d14-9db0-48e3-923d-2b4a144c4dfa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:11.517855 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-801c1d14-9db0-48e3-923d-2b4a144c4dfa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.518308 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-801c1d14-9db0-48e3-923d-2b4a144c4dfa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:11.651770 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-801c1d14-9db0-48e3-923d-2b4a144c4dfa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:11.658950 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-801c1d14-9db0-48e3-923d-2b4a144c4dfa tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1549 microversion: 2.1 time: 0.152317 Jan 28 20:33:11.659519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 398/776] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:11 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:11.674177 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-44d86415-38f9-455c-b291-527d85808708 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:11.677579 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:33:11.677579 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:33:11.678682 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-44d86415-38f9-455c-b291-527d85808708 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:11.679429 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-44d86415-38f9-455c-b291-527d85808708 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Searching by: {'deleted': False, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25'} {{(pid=116275) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 28 20:33:11.685847 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-44d86415-38f9-455c-b291-527d85808708 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.686325 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-44d86415-38f9-455c-b291-527d85808708 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:11.687140 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-44d86415-38f9-455c-b291-527d85808708 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.687574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-44d86415-38f9-455c-b291-527d85808708 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:11.775058 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.multi_cell_list [None req-44d86415-38f9-455c-b291-527d85808708 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116275) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 28 20:33:11.829580 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:11.830368 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:11.836467 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.836907 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:11.837669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.838118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:11.868928 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-44d86415-38f9-455c-b291-527d85808708 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.198123 Jan 28 20:33:11.869432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 379/777] 10.222.0.59 () {58 vars in 1124 bytes} [Fri Jan 28 20:33:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:33:11.878924 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-aa5f58bf-7273-4ddc-94f8-f9518345e47b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:11.879526 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-aa5f58bf-7273-4ddc-94f8-f9518345e47b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:11.885791 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5f58bf-7273-4ddc-94f8-f9518345e47b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.886267 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5f58bf-7273-4ddc-94f8-f9518345e47b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:11.887047 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5f58bf-7273-4ddc-94f8-f9518345e47b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:11.887477 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5f58bf-7273-4ddc-94f8-f9518345e47b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:12.000409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:12.008127 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:12.009590 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:12.010762 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b1529867-ef81-4461-b255-c743feb18a1f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.184827 Jan 28 20:33:12.011321 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 399/778] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:11 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:33:12.055906 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-aa5f58bf-7273-4ddc-94f8-f9518345e47b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:12.063056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-aa5f58bf-7273-4ddc-94f8-f9518345e47b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1549 microversion: 2.1 time: 0.187600 Jan 28 20:33:12.063616 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 380/779] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:11 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:33:13.029136 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:13.029731 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:13.036541 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:13.036983 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:13.037759 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:13.038347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:13.170232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:13.177998 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:13.179482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:13.180660 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8163f66a-0dee-47de-9ca6-64cad9bb3fe1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.155285 Jan 28 20:33:13.181221 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 400/780] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:13 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:13.547676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-39de09d1-0e01-4488-8fbb-fbef0a431fbe tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "803429d1-2f45-40f1-87c6-91a918868589"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:13.548501 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-39de09d1-0e01-4488-8fbb-fbef0a431fbe tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:13.554593 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39de09d1-0e01-4488-8fbb-fbef0a431fbe tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:13.555588 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39de09d1-0e01-4488-8fbb-fbef0a431fbe tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:13.556363 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39de09d1-0e01-4488-8fbb-fbef0a431fbe tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:13.556797 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39de09d1-0e01-4488-8fbb-fbef0a431fbe tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:13.931865 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-39de09d1-0e01-4488-8fbb-fbef0a431fbe tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "POST /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387975 Jan 28 20:33:13.932491 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 381/781] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:33:13 2022] POST /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:33:14.198536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:14.199154 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:14.205367 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:14.205814 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:14.206628 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:14.207061 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:14.337404 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:14.344972 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:14.346608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:14.347756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b1a179ed-378d-480b-ab2b-9f08c7c86b1e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.152961 Jan 28 20:33:14.348315 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 401/782] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:14 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:14.825692 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f34c5e21-903d-47dc-918e-ec7dab46cea3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b14dc2c2-91f3-4ad3-a8df-e27817b8332e"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:14.826897 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f34c5e21-903d-47dc-918e-ec7dab46cea3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:14.832959 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34c5e21-903d-47dc-918e-ec7dab46cea3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:14.833402 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34c5e21-903d-47dc-918e-ec7dab46cea3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:14.834207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34c5e21-903d-47dc-918e-ec7dab46cea3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:14.834638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f34c5e21-903d-47dc-918e-ec7dab46cea3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:15.058882 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f34c5e21-903d-47dc-918e-ec7dab46cea3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238070 Jan 28 20:33:15.059502 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 382/783] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:33:14 2022] POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:33:15.365641 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:15.366211 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:15.372405 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:15.372847 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:15.373628 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:15.374091 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:15.506216 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:15.514494 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:15.515966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:15.517261 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-71241382-e3f4-468a-b8a9-db4f98122e11 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.155312 Jan 28 20:33:15.517858 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 402/784] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:15 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:16.536165 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:16.536859 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:16.543330 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:16.543769 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:16.544634 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:16.545062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:16.675763 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:16.683905 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:16.685381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:16.686541 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a49742f0-f4f0-4eaa-a79c-8278a5f96538 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.154513 Jan 28 20:33:16.687093 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 383/785] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:16 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:17.704319 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:17.704957 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:17.711230 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:17.711683 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:17.712455 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:17.712891 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:17.845940 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:17.854240 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:17.855744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:17.856931 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-faf7dd06-9744-40f1-b69d-47cec9f8d3d3 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.156338 Jan 28 20:33:17.857498 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 403/786] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:17 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:18.875354 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:18.875906 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:18.882135 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:18.882582 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:18.883943 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:18.884395 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:19.016902 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:19.024772 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:19.026282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:19.027412 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f4ee52e7-3be3-41c2-a3bf-238aceadb69f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1743 microversion: 2.20 time: 0.155844 Jan 28 20:33:19.027962 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 384/787] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:18 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:20.045535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:20.046153 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:20.052458 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:20.052897 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:20.053667 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:20.054121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:20.182979 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:20.190755 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:20.192236 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:20.193378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9d463bca-e7b9-4b29-a3d0-26ed138a7f71 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1743 microversion: 2.20 time: 0.151553 Jan 28 20:33:20.193958 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 404/788] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:20 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:21.212758 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:21.213364 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:21.219163 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:21.219604 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:21.220369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:21.220796 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:21.364652 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:21.372394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:21.373916 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:21.375087 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ab1bc35f-9434-4ebd-aec8-4965e5ac6ae9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1743 microversion: 2.20 time: 0.167190 Jan 28 20:33:21.375646 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 385/789] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:21 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:21.481281 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8fbce9d4-2d25-415f-9d47-4217020ce136 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:21.481953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8fbce9d4-2d25-415f-9d47-4217020ce136 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:21.488133 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8fbce9d4-2d25-415f-9d47-4217020ce136 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:21.488591 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8fbce9d4-2d25-415f-9d47-4217020ce136 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:21.489357 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8fbce9d4-2d25-415f-9d47-4217020ce136 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:21.489785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8fbce9d4-2d25-415f-9d47-4217020ce136 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:21.623232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8fbce9d4-2d25-415f-9d47-4217020ce136 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:21.631365 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8fbce9d4-2d25-415f-9d47-4217020ce136 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1595 microversion: 2.1 time: 0.154116 Jan 28 20:33:21.631931 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 405/790] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:21 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:22.394039 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:22.394701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:22.401029 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:22.401467 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:22.402272 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:22.402698 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:22.631867 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-98a9fe9f-f096-4470-8a4b-96143239e721 req-9e2c1974-0c6c-46dd-96f6-a1138017853f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc7cc38-742f-4269-8cb6-7cf3e97f1654", "name": "network-vif-plugged", "status": "completed", "tag": "2b3708de-bc79-4020-8e5f-b6aecdd43ef2"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:22.634259 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:33:22.634259 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:33:22.642150 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-98a9fe9f-f096-4470-8a4b-96143239e721 req-9e2c1974-0c6c-46dd-96f6-a1138017853f service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:22.642695 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-98a9fe9f-f096-4470-8a4b-96143239e721 req-9e2c1974-0c6c-46dd-96f6-a1138017853f service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:22.654734 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:22.658900 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-98a9fe9f-f096-4470-8a4b-96143239e721 req-9e2c1974-0c6c-46dd-96f6-a1138017853f service nova] Creating event network-vif-plugged:2b3708de-bc79-4020-8e5f-b6aecdd43ef2 for instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 on hv-cinder-82635 Jan 28 20:33:22.665604 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-98a9fe9f-f096-4470-8a4b-96143239e721 req-9e2c1974-0c6c-46dd-96f6-a1138017853f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037371 Jan 28 20:33:22.666874 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 406/791] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:33:22.668438 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:22.670034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:22.671224 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1772f531-9e0b-4c58-8fa9-2d34b9956ffd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1743 microversion: 2.20 time: 0.281402 Jan 28 20:33:22.682272 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 386/792] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:22 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1743 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:23.690805 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:23.692737 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:23.702603 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-2100d5b6-dde3-480d-a9d1-e3585b5d30c6 req-02e58019-d388-42f2-ba77-cdf7004b3249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16081702-e065-419c-bb8c-8bb4ee6a7470", "tag": "93c9ee57-f372-42ef-bca7-ac691fd1d6e3"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:23.707892 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:33:23.707892 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:33:23.715614 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:23.719955 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-2100d5b6-dde3-480d-a9d1-e3585b5d30c6 req-02e58019-d388-42f2-ba77-cdf7004b3249 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:23.720448 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:23.721394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:23.721931 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:23.724887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-2100d5b6-dde3-480d-a9d1-e3585b5d30c6 req-02e58019-d388-42f2-ba77-cdf7004b3249 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:23.738655 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-2100d5b6-dde3-480d-a9d1-e3585b5d30c6 req-02e58019-d388-42f2-ba77-cdf7004b3249 service nova] Creating event network-changed:93c9ee57-f372-42ef-bca7-ac691fd1d6e3 for instance 16081702-e065-419c-bb8c-8bb4ee6a7470 on hv-cinder-82635 Jan 28 20:33:23.744977 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-2100d5b6-dde3-480d-a9d1-e3585b5d30c6 req-02e58019-d388-42f2-ba77-cdf7004b3249 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111022 Jan 28 20:33:23.746450 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 407/793] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:33:23.911282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:23.921526 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:23.923433 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:23.924799 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1b7eced4-a677-4904-8ba0-88ed3e2b509b tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1743 microversion: 2.20 time: 0.238904 Jan 28 20:33:23.925694 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 387/794] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:23 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1743 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:24.811656 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4b9a3784-680a-4b4c-a141-6a76ac5a684f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1339825803"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:24.812276 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4b9a3784-680a-4b4c-a141-6a76ac5a684f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:24.818637 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4b9a3784-680a-4b4c-a141-6a76ac5a684f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:24.819091 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4b9a3784-680a-4b4c-a141-6a76ac5a684f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:24.819874 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4b9a3784-680a-4b4c-a141-6a76ac5a684f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:24.820877 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4b9a3784-680a-4b4c-a141-6a76ac5a684f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:24.945963 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:24.947829 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:24.960577 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:24.962229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:24.963454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:24.964089 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:25.052538 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.network.security_group_api [None req-4b9a3784-680a-4b4c-a141-6a76ac5a684f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Adding security group afcf3622-c704-4afc-a941-d7855444063a to port 93c9ee57-f372-42ef-bca7-ac691fd1d6e3 Jan 28 20:33:25.335021 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:25.346130 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:25.347940 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:25.349675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1d09a5d1-b6b0-4656-aeb7-619ed45c2705 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1738 microversion: 2.20 time: 0.410468 Jan 28 20:33:25.362068 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 388/795] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:24 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1738 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:25.633352 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4b9a3784-680a-4b4c-a141-6a76ac5a684f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "POST /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/action" status: 202 len: 0 microversion: 2.1 time: 0.827209 Jan 28 20:33:25.634725 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 408/796] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:33:24 2022] POST /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 20:33:25.643194 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7a987452-d4e7-4a0c-91ba-8aa659f1d7bb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:25.643943 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7a987452-d4e7-4a0c-91ba-8aa659f1d7bb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:25.655789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7a987452-d4e7-4a0c-91ba-8aa659f1d7bb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:25.660043 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7a987452-d4e7-4a0c-91ba-8aa659f1d7bb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:25.662817 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7a987452-d4e7-4a0c-91ba-8aa659f1d7bb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:25.664663 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7a987452-d4e7-4a0c-91ba-8aa659f1d7bb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:25.771068 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-ae1e99fa-1aae-414a-8382-21c9bf9eda9d req-82e671ac-8e3a-46f0-b73a-e76fbd9f3120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16081702-e065-419c-bb8c-8bb4ee6a7470", "tag": "93c9ee57-f372-42ef-bca7-ac691fd1d6e3"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:25.773482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:33:25.773482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:33:25.791631 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-ae1e99fa-1aae-414a-8382-21c9bf9eda9d req-82e671ac-8e3a-46f0-b73a-e76fbd9f3120 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:25.791863 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-ae1e99fa-1aae-414a-8382-21c9bf9eda9d req-82e671ac-8e3a-46f0-b73a-e76fbd9f3120 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:25.842903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-ae1e99fa-1aae-414a-8382-21c9bf9eda9d req-82e671ac-8e3a-46f0-b73a-e76fbd9f3120 service nova] Creating event network-changed:93c9ee57-f372-42ef-bca7-ac691fd1d6e3 for instance 16081702-e065-419c-bb8c-8bb4ee6a7470 on hv-cinder-82635 Jan 28 20:33:25.852111 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-ae1e99fa-1aae-414a-8382-21c9bf9eda9d req-82e671ac-8e3a-46f0-b73a-e76fbd9f3120 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088787 Jan 28 20:33:25.852751 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 409/797] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:33:25.949722 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-7a987452-d4e7-4a0c-91ba-8aa659f1d7bb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:25.957909 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7a987452-d4e7-4a0c-91ba-8aa659f1d7bb tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1760 microversion: 2.1 time: 0.319072 Jan 28 20:33:25.960733 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 389/798] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:25 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1760 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:26.372428 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:26.374648 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:26.396174 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:26.400163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:26.405708 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:26.406609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:26.617857 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:26.630569 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:26.632049 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:26.633241 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ce00d92a-5e86-4d1f-a33c-9ee84fb70139 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1738 microversion: 2.20 time: 0.266000 Jan 28 20:33:26.633799 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 410/799] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:26 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:33:27.652157 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:27.653513 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:27.660317 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:27.660761 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:27.661542 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:27.662007 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:27.828601 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:27.840271 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:27.841925 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:27.843105 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-19cc5d4e-e09b-41d9-b98a-880d481d8c07 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1738 microversion: 2.20 time: 0.195357 Jan 28 20:33:27.853907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 390/800] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:27 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:33:27.975219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e5fdf5d0-7151-4b75-9d12-ca2eb8f75e69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:27.982642 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e5fdf5d0-7151-4b75-9d12-ca2eb8f75e69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:27.983369 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e5fdf5d0-7151-4b75-9d12-ca2eb8f75e69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:28.047431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e5fdf5d0-7151-4b75-9d12-ca2eb8f75e69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Going to try to stop instance {{(pid=116276) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 20:33:28.094016 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e5fdf5d0-7151-4b75-9d12-ca2eb8f75e69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/action" status: 202 len: 0 microversion: 2.1 time: 0.122390 Jan 28 20:33:28.094847 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 411/801] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:33:27 2022] POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:33:28.102307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b3884837-2f3a-4e3c-8388-3a0e275e37d4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:28.103290 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b3884837-2f3a-4e3c-8388-3a0e275e37d4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:28.109419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b3884837-2f3a-4e3c-8388-3a0e275e37d4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:28.110153 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b3884837-2f3a-4e3c-8388-3a0e275e37d4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:28.111213 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b3884837-2f3a-4e3c-8388-3a0e275e37d4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:28.111805 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b3884837-2f3a-4e3c-8388-3a0e275e37d4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:28.261980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b3884837-2f3a-4e3c-8388-3a0e275e37d4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:28.271569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b3884837-2f3a-4e3c-8388-3a0e275e37d4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.172745 Jan 28 20:33:28.272175 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 391/802] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:28 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:28.865972 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:28.866810 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:28.873568 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:28.874133 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:28.875055 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:28.875542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:29.026268 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:29.040973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:29.042805 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:29.043960 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d26c3db5-fbf6-43f2-885d-bf0c16b01d17 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1738 microversion: 2.20 time: 0.182419 Jan 28 20:33:29.045062 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 412/803] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:28 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:29.289496 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c006be29-4601-4496-9c5e-7110c608647f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:29.290122 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c006be29-4601-4496-9c5e-7110c608647f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:29.298574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c006be29-4601-4496-9c5e-7110c608647f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:29.299273 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c006be29-4601-4496-9c5e-7110c608647f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:29.300244 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c006be29-4601-4496-9c5e-7110c608647f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:29.300670 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c006be29-4601-4496-9c5e-7110c608647f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:29.463551 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c006be29-4601-4496-9c5e-7110c608647f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:29.471905 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c006be29-4601-4496-9c5e-7110c608647f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.186641 Jan 28 20:33:29.472856 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 392/804] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:29 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:30.062650 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:30.064017 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:30.071350 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:30.071876 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:30.073032 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:30.073473 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:30.235859 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:30.251366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:30.253193 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:30.254449 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-18f7f625-ab7f-4482-8ba2-2e8ba6bee9bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1738 microversion: 2.20 time: 0.195633 Jan 28 20:33:30.255023 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 413/805] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:30 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:30.489170 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-57ba6fd5-ebaa-49fe-840d-2c72a9572404 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:30.489979 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-57ba6fd5-ebaa-49fe-840d-2c72a9572404 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:30.499761 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57ba6fd5-ebaa-49fe-840d-2c72a9572404 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:30.500288 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57ba6fd5-ebaa-49fe-840d-2c72a9572404 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:30.501408 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57ba6fd5-ebaa-49fe-840d-2c72a9572404 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:30.501925 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57ba6fd5-ebaa-49fe-840d-2c72a9572404 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:30.665156 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-57ba6fd5-ebaa-49fe-840d-2c72a9572404 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:30.674383 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-57ba6fd5-ebaa-49fe-840d-2c72a9572404 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.189371 Jan 28 20:33:30.680433 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 393/806] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:30 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:31.272357 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:31.273848 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:31.281079 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:31.281519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:31.282332 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:31.282922 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:31.436768 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:31.445117 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:31.446700 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:31.447890 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-06db0697-17e0-4f28-8c1b-ed9450bfc0a6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1738 microversion: 2.20 time: 0.179259 Jan 28 20:33:31.448657 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 414/807] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:31 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:31.693910 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-476f33b6-078d-4d0e-9c81-9575e8272433 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:31.694787 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-476f33b6-078d-4d0e-9c81-9575e8272433 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:31.706691 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-476f33b6-078d-4d0e-9c81-9575e8272433 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:31.707284 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-476f33b6-078d-4d0e-9c81-9575e8272433 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:31.708185 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-476f33b6-078d-4d0e-9c81-9575e8272433 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:31.708728 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-476f33b6-078d-4d0e-9c81-9575e8272433 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:31.869432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-476f33b6-078d-4d0e-9c81-9575e8272433 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:31.878433 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-476f33b6-078d-4d0e-9c81-9575e8272433 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.189996 Jan 28 20:33:31.878929 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 394/808] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:31 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:32.469102 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:32.470428 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:32.479256 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:32.479699 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:32.480486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:32.480915 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:32.639796 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:32.649825 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:32.651719 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:32.653173 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b2e1ba2f-6336-4a76-8592-477ea04abea6 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1738 microversion: 2.20 time: 0.188991 Jan 28 20:33:32.654027 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 415/809] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:32 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:32.896978 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4b5aa97b-5f79-4560-92e8-73ab994f42ed tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:32.897716 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4b5aa97b-5f79-4560-92e8-73ab994f42ed tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:32.906402 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b5aa97b-5f79-4560-92e8-73ab994f42ed tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:32.907801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b5aa97b-5f79-4560-92e8-73ab994f42ed tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:32.908804 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b5aa97b-5f79-4560-92e8-73ab994f42ed tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:32.909235 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4b5aa97b-5f79-4560-92e8-73ab994f42ed tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:33.098323 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4b5aa97b-5f79-4560-92e8-73ab994f42ed tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:33.107391 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4b5aa97b-5f79-4560-92e8-73ab994f42ed tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.214530 Jan 28 20:33:33.117790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 395/810] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:32 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:33.673200 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:33.673794 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:33.681065 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:33.681505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:33.683254 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:33.683254 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:33.836197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:33.844255 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:33.845761 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:33.846949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8982842f-d8bf-4c23-a1ca-70dd785ac89f tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1738 microversion: 2.20 time: 0.177938 Jan 28 20:33:33.847509 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 416/811] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:33 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:34.124377 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ef719800-1ee1-4dfc-8d67-7f8a2e44d00c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:34.125009 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ef719800-1ee1-4dfc-8d67-7f8a2e44d00c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:34.131261 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ef719800-1ee1-4dfc-8d67-7f8a2e44d00c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:34.131701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ef719800-1ee1-4dfc-8d67-7f8a2e44d00c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:34.132976 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ef719800-1ee1-4dfc-8d67-7f8a2e44d00c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:34.133402 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ef719800-1ee1-4dfc-8d67-7f8a2e44d00c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:34.270824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ef719800-1ee1-4dfc-8d67-7f8a2e44d00c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:34.279315 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ef719800-1ee1-4dfc-8d67-7f8a2e44d00c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.158600 Jan 28 20:33:34.279880 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 396/812] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:34 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:34.864369 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:34.864982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:34.871912 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:34.872362 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:34.873151 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:34.873592 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:35.008285 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:35.015982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:35.017590 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:35.018760 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-560700a7-5475-4a57-9b18-f0f385c7238c tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1720 microversion: 2.20 time: 0.158126 Jan 28 20:33:35.019310 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 417/813] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:34 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:35.295936 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-63e9dd5e-3cb2-4d3b-8842-dcac3666478d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:35.296584 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-63e9dd5e-3cb2-4d3b-8842-dcac3666478d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:35.302848 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-63e9dd5e-3cb2-4d3b-8842-dcac3666478d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:35.303890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-63e9dd5e-3cb2-4d3b-8842-dcac3666478d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:35.304765 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-63e9dd5e-3cb2-4d3b-8842-dcac3666478d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:35.305204 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-63e9dd5e-3cb2-4d3b-8842-dcac3666478d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:35.439430 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-63e9dd5e-3cb2-4d3b-8842-dcac3666478d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:35.447128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-63e9dd5e-3cb2-4d3b-8842-dcac3666478d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.154972 Jan 28 20:33:35.447694 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 397/814] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:35 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:36.037672 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:36.038384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:36.045614 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:36.046103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:36.046885 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:36.047318 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:36.176887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:36.184903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:36.186620 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:36.187785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ecb41bd6-0833-45bd-9eda-232519c639f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1720 microversion: 2.20 time: 0.153825 Jan 28 20:33:36.188732 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 418/815] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:36 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:36.464800 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2f0f581d-4c84-4cf5-a855-dc205cb5481d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:36.465409 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2f0f581d-4c84-4cf5-a855-dc205cb5481d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:36.471885 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2f0f581d-4c84-4cf5-a855-dc205cb5481d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:36.472328 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2f0f581d-4c84-4cf5-a855-dc205cb5481d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:36.473099 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2f0f581d-4c84-4cf5-a855-dc205cb5481d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:36.473523 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2f0f581d-4c84-4cf5-a855-dc205cb5481d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:36.612301 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2f0f581d-4c84-4cf5-a855-dc205cb5481d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:36.619931 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2f0f581d-4c84-4cf5-a855-dc205cb5481d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.159363 Jan 28 20:33:36.620494 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 398/816] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:36 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:37.206406 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:37.207001 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:37.213172 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:37.213611 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:37.214403 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:37.214830 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:37.350024 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:37.358135 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:37.359724 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:37.360856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-591175f0-0d6a-4fe8-9b72-e23f30dcdea8 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1723 microversion: 2.20 time: 0.158144 Jan 28 20:33:37.361421 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 419/817] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:37 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:37.378108 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9213b762-7e16-4fd2-a2bb-7ad0ab21e0a2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7681473-b809-435e-b675-55eec4870bc9"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:37.379367 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9213b762-7e16-4fd2-a2bb-7ad0ab21e0a2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:37.385068 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9213b762-7e16-4fd2-a2bb-7ad0ab21e0a2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:37.385507 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9213b762-7e16-4fd2-a2bb-7ad0ab21e0a2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:37.386302 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9213b762-7e16-4fd2-a2bb-7ad0ab21e0a2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:37.386730 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9213b762-7e16-4fd2-a2bb-7ad0ab21e0a2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:37.637025 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0c5e6818-784e-47d5-aa96-63a81b77e1f1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:37.637628 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0c5e6818-784e-47d5-aa96-63a81b77e1f1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:37.643505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c5e6818-784e-47d5-aa96-63a81b77e1f1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:37.643949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c5e6818-784e-47d5-aa96-63a81b77e1f1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:37.644732 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c5e6818-784e-47d5-aa96-63a81b77e1f1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:37.645232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0c5e6818-784e-47d5-aa96-63a81b77e1f1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:37.664104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9213b762-7e16-4fd2-a2bb-7ad0ab21e0a2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "POST /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289185 Jan 28 20:33:37.664718 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 399/818] 10.222.0.59 () {62 vars in 1363 bytes} [Fri Jan 28 20:33:37 2022] POST /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 20:33:37.771638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f1330c29-f7be-431b-8f00-ffcadfc9d2f9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:37.772131 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f1330c29-f7be-431b-8f00-ffcadfc9d2f9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:37.778788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f1330c29-f7be-431b-8f00-ffcadfc9d2f9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:37.779240 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f1330c29-f7be-431b-8f00-ffcadfc9d2f9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:37.780069 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f1330c29-f7be-431b-8f00-ffcadfc9d2f9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:37.780498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f1330c29-f7be-431b-8f00-ffcadfc9d2f9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:37.784502 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0c5e6818-784e-47d5-aa96-63a81b77e1f1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:37.792717 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0c5e6818-784e-47d5-aa96-63a81b77e1f1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.159376 Jan 28 20:33:37.793286 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 420/819] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:37 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:33:37.992796 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f1330c29-f7be-431b-8f00-ffcadfc9d2f9 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/os-volume_attachments/f7681473-b809-435e-b675-55eec4870bc9" status: 202 len: 0 microversion: 2.20 time: 0.224866 Jan 28 20:33:37.993736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 400/820] 10.222.0.59 () {60 vars in 1456 bytes} [Fri Jan 28 20:33:37 2022] DELETE /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/os-volume_attachments/f7681473-b809-435e-b675-55eec4870bc9 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 20:33:38.045707 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c6dea241-1f1b-4a68-8d3f-e566a7e26186 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:38.046359 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c6dea241-1f1b-4a68-8d3f-e566a7e26186 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:38.052201 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c6dea241-1f1b-4a68-8d3f-e566a7e26186 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:38.052648 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c6dea241-1f1b-4a68-8d3f-e566a7e26186 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:38.053426 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c6dea241-1f1b-4a68-8d3f-e566a7e26186 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:38.053862 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c6dea241-1f1b-4a68-8d3f-e566a7e26186 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:38.140231 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c6dea241-1f1b-4a68-8d3f-e566a7e26186 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "POST /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/action" status: 202 len: 0 microversion: 2.20 time: 0.098143 Jan 28 20:33:38.140835 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 421/821] 10.222.0.59 () {62 vars in 1318 bytes} [Fri Jan 28 20:33:38 2022] POST /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:33:38.149068 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:38.149756 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:38.156018 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:38.156454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:38.157311 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:38.157745 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:38.300113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:38.308003 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:38.309584 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:38.310770 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-05144056-b17b-4e51-97b7-eb466956b39a tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1671 microversion: 2.20 time: 0.165800 Jan 28 20:33:38.311808 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 401/822] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:38 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:38.628253 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-37e470d9-06c5-4d10-b51e-32b9fb43f922 req-5c27f3e5-57ee-462d-adeb-a5facd8c0306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc7cc38-742f-4269-8cb6-7cf3e97f1654", "name": "network-vif-unplugged", "status": "completed", "tag": "2b3708de-bc79-4020-8e5f-b6aecdd43ef2"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:38.630946 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:33:38.630946 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:33:38.641211 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-37e470d9-06c5-4d10-b51e-32b9fb43f922 req-5c27f3e5-57ee-462d-adeb-a5facd8c0306 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:38.641925 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-37e470d9-06c5-4d10-b51e-32b9fb43f922 req-5c27f3e5-57ee-462d-adeb-a5facd8c0306 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:38.653264 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.compute.server_external_events [req-37e470d9-06c5-4d10-b51e-32b9fb43f922 req-5c27f3e5-57ee-462d-adeb-a5facd8c0306 service nova] Unable to find a host for instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654. Dropping event network-vif-unplugged {{(pid=116276) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 28 20:33:38.654290 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-37e470d9-06c5-4d10-b51e-32b9fb43f922 req-5c27f3e5-57ee-462d-adeb-a5facd8c0306 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034560 Jan 28 20:33:38.655075 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 422/823] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 28 20:33:38.809265 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6251f1e7-174f-45cd-bf9f-a6c4cd0cbbfa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:38.810027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6251f1e7-174f-45cd-bf9f-a6c4cd0cbbfa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:38.817961 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6251f1e7-174f-45cd-bf9f-a6c4cd0cbbfa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:38.818489 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6251f1e7-174f-45cd-bf9f-a6c4cd0cbbfa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:38.819280 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6251f1e7-174f-45cd-bf9f-a6c4cd0cbbfa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:38.819792 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6251f1e7-174f-45cd-bf9f-a6c4cd0cbbfa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:38.962147 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6251f1e7-174f-45cd-bf9f-a6c4cd0cbbfa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:38.970788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6251f1e7-174f-45cd-bf9f-a6c4cd0cbbfa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.164967 Jan 28 20:33:38.971783 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 402/824] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:38 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:39.329519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:39.330257 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:39.336536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:39.336973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:39.337761 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:39.338216 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:39.473753 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:39.481747 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:39.483365 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:39.484635 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-69293b4d-5a87-487e-9225-8d67ea890376 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.158894 Jan 28 20:33:39.485279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 423/825] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:39 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:39.987749 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d3452457-868f-44e4-9fbc-0dc40e48bbbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:39.988624 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d3452457-868f-44e4-9fbc-0dc40e48bbbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:39.995975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3452457-868f-44e4-9fbc-0dc40e48bbbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:39.996429 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3452457-868f-44e4-9fbc-0dc40e48bbbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:39.997236 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3452457-868f-44e4-9fbc-0dc40e48bbbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:39.997667 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3452457-868f-44e4-9fbc-0dc40e48bbbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:40.133235 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d3452457-868f-44e4-9fbc-0dc40e48bbbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:40.141150 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d3452457-868f-44e4-9fbc-0dc40e48bbbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.157237 Jan 28 20:33:40.141890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 403/826] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:39 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:40.505903 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:40.506522 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:40.513143 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:40.513597 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:40.514456 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:40.514954 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:40.669792 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:40.678523 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:40.680696 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:40.681844 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3da05cda-d7ee-440c-ba2e-a5c6220a3efc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.179630 Jan 28 20:33:40.682424 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 424/827] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:40 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:33:41.160036 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-61de760d-819c-438f-914d-e37f596e3070 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:41.160900 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-61de760d-819c-438f-914d-e37f596e3070 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:41.167333 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-61de760d-819c-438f-914d-e37f596e3070 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:41.167861 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-61de760d-819c-438f-914d-e37f596e3070 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:41.168723 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-61de760d-819c-438f-914d-e37f596e3070 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:41.169232 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-61de760d-819c-438f-914d-e37f596e3070 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:41.308723 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-61de760d-819c-438f-914d-e37f596e3070 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:41.316834 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-61de760d-819c-438f-914d-e37f596e3070 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.161038 Jan 28 20:33:41.317731 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 404/828] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:41 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:41.700561 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:41.702118 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:41.708445 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:41.708888 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:41.709667 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:41.710145 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:41.853555 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:41.862128 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:41.863626 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:41.864814 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-08de50c4-c9ed-499d-b9f1-2bd576ccea64 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.168538 Jan 28 20:33:41.865380 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 425/829] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:41 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:42.334893 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-47271006-8911-4668-b047-e5e2ecfa7424 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:42.335487 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-47271006-8911-4668-b047-e5e2ecfa7424 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:42.342136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-47271006-8911-4668-b047-e5e2ecfa7424 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:42.342587 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-47271006-8911-4668-b047-e5e2ecfa7424 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:42.343382 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-47271006-8911-4668-b047-e5e2ecfa7424 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:42.343818 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-47271006-8911-4668-b047-e5e2ecfa7424 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:42.483104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-47271006-8911-4668-b047-e5e2ecfa7424 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:42.491179 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-47271006-8911-4668-b047-e5e2ecfa7424 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.159931 Jan 28 20:33:42.491790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 405/830] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:42 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:42.883102 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:42.883693 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:42.890126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:42.890587 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:42.891407 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:42.891924 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:43.042519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:43.052105 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:43.054835 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:43.056335 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1e098689-34d5-4359-bbc9-de6bcfb9a56d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.177470 Jan 28 20:33:43.057338 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 426/831] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:42 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:43.509160 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cf1e66fd-aed0-4059-9a7c-418f349e8df1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:43.509946 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cf1e66fd-aed0-4059-9a7c-418f349e8df1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:43.517237 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cf1e66fd-aed0-4059-9a7c-418f349e8df1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:43.517681 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cf1e66fd-aed0-4059-9a7c-418f349e8df1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:43.518494 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cf1e66fd-aed0-4059-9a7c-418f349e8df1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:43.518920 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cf1e66fd-aed0-4059-9a7c-418f349e8df1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:43.671346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-cf1e66fd-aed0-4059-9a7c-418f349e8df1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:43.680419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cf1e66fd-aed0-4059-9a7c-418f349e8df1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.176063 Jan 28 20:33:43.681253 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 406/832] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:43 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:44.074120 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:44.074730 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:44.081029 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:44.081472 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:44.082356 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:44.082805 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:44.229896 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:44.237789 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:44.239269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:44.240395 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9c6dda34-6d61-4d03-b31a-02144a0c322e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.169938 Jan 28 20:33:44.240970 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 427/833] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:44 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:44.698008 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f95006ff-9ca3-4b1a-961b-c7c1c9122fc4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:44.698747 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f95006ff-9ca3-4b1a-961b-c7c1c9122fc4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:44.705254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f95006ff-9ca3-4b1a-961b-c7c1c9122fc4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:44.705703 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f95006ff-9ca3-4b1a-961b-c7c1c9122fc4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:44.706514 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f95006ff-9ca3-4b1a-961b-c7c1c9122fc4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:44.706951 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f95006ff-9ca3-4b1a-961b-c7c1c9122fc4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:44.845505 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f95006ff-9ca3-4b1a-961b-c7c1c9122fc4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:44.854195 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f95006ff-9ca3-4b1a-961b-c7c1c9122fc4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.160271 Jan 28 20:33:44.855029 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 407/834] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:44 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:45.259049 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:45.259624 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:45.266068 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:45.266616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:45.267779 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:45.268278 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:45.412845 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:45.421399 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:45.423206 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:45.424368 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a52b9d8f-c701-4b7e-aaa0-e8408326bfb1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.169272 Jan 28 20:33:45.424934 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 428/835] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:45 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:45.871487 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4183b8df-e05e-4bd2-8522-0e86bd22505f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:45.872100 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4183b8df-e05e-4bd2-8522-0e86bd22505f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:45.878620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4183b8df-e05e-4bd2-8522-0e86bd22505f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:45.879076 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4183b8df-e05e-4bd2-8522-0e86bd22505f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:45.879876 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4183b8df-e05e-4bd2-8522-0e86bd22505f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:45.880310 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4183b8df-e05e-4bd2-8522-0e86bd22505f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:46.032565 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4183b8df-e05e-4bd2-8522-0e86bd22505f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:46.043369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4183b8df-e05e-4bd2-8522-0e86bd22505f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.175473 Jan 28 20:33:46.043941 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 408/836] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:45 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:46.442250 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:46.443711 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:46.450460 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:46.451193 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:46.452194 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:46.452698 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:46.595528 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:46.603502 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:46.604991 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:46.606165 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8448caa4-11c1-4c86-a855-671872f1a9e4 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.167648 Jan 28 20:33:46.617206 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 429/837] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:46 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:47.060621 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-198d9538-539b-401f-8e11-c3cd982a2a3d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:47.061310 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-198d9538-539b-401f-8e11-c3cd982a2a3d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:47.067740 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-198d9538-539b-401f-8e11-c3cd982a2a3d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:47.068184 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-198d9538-539b-401f-8e11-c3cd982a2a3d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:47.068998 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-198d9538-539b-401f-8e11-c3cd982a2a3d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:47.070184 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-198d9538-539b-401f-8e11-c3cd982a2a3d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:47.206600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-198d9538-539b-401f-8e11-c3cd982a2a3d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:47.214586 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-198d9538-539b-401f-8e11-c3cd982a2a3d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.157567 Jan 28 20:33:47.215369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 409/838] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:47 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:33:47.624373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:47.625126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:47.632911 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:47.633352 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:47.634200 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:47.634632 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:47.780913 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:47.788932 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:47.790469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:47.791693 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f0d70102-5cc3-46ff-8478-820acf4391f1 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.171019 Jan 28 20:33:47.792577 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 430/839] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:47 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:48.231867 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1ca76391-1ae2-435a-b3a8-4616d39938e9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:48.232546 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1ca76391-1ae2-435a-b3a8-4616d39938e9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:48.238783 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1ca76391-1ae2-435a-b3a8-4616d39938e9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:48.239254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1ca76391-1ae2-435a-b3a8-4616d39938e9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:48.240090 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1ca76391-1ae2-435a-b3a8-4616d39938e9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:48.240467 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1ca76391-1ae2-435a-b3a8-4616d39938e9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:48.392189 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1ca76391-1ae2-435a-b3a8-4616d39938e9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:48.401942 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1ca76391-1ae2-435a-b3a8-4616d39938e9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.173715 Jan 28 20:33:48.402525 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 410/840] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:48 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:48.810567 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:48.811197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:48.817502 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:48.817976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:48.818763 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:48.819230 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:48.971239 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:48.980787 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:48.982409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:48.983672 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-420866e2-cfb8-47c3-86c7-51fc7fd5d3bb tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.177041 Jan 28 20:33:48.985959 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 431/841] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:48 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:49.420486 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-14adb4fe-b3d2-46e1-97c6-b54bb5bab722 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:49.421377 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-14adb4fe-b3d2-46e1-97c6-b54bb5bab722 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:49.428292 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-14adb4fe-b3d2-46e1-97c6-b54bb5bab722 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:49.428734 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-14adb4fe-b3d2-46e1-97c6-b54bb5bab722 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:49.429522 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-14adb4fe-b3d2-46e1-97c6-b54bb5bab722 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:49.429982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-14adb4fe-b3d2-46e1-97c6-b54bb5bab722 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:49.571340 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-14adb4fe-b3d2-46e1-97c6-b54bb5bab722 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:49.579009 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-14adb4fe-b3d2-46e1-97c6-b54bb5bab722 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.162585 Jan 28 20:33:49.579575 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 411/842] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:49 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:50.001779 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:50.002436 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:50.008641 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:50.009080 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:50.009841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:50.010298 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:50.138934 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:50.146505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:50.148489 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:50.149618 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f11706b4-85ec-4733-8856-e8f94d1fe1e2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.151588 Jan 28 20:33:50.150215 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 432/843] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:49 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:50.596182 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-803780a1-beeb-465e-9a75-b616c05e1c2d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:50.596817 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-803780a1-beeb-465e-9a75-b616c05e1c2d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:50.602953 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-803780a1-beeb-465e-9a75-b616c05e1c2d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:50.603390 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-803780a1-beeb-465e-9a75-b616c05e1c2d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:50.604153 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-803780a1-beeb-465e-9a75-b616c05e1c2d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:50.604580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-803780a1-beeb-465e-9a75-b616c05e1c2d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:50.736414 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-803780a1-beeb-465e-9a75-b616c05e1c2d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:50.744284 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-803780a1-beeb-465e-9a75-b616c05e1c2d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.151689 Jan 28 20:33:50.744866 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 412/844] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:50 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:51.168485 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:51.169183 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:51.175886 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:51.176325 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:51.177091 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:51.177516 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:51.308595 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:51.316529 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:51.318102 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:51.319229 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8731f708-74af-41a6-9860-dc566cd45afe tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.154638 Jan 28 20:33:51.319781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 433/845] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:51 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:51.760809 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9a4e5625-a5b0-4f52-b51a-b31ba5e376e0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:51.761410 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9a4e5625-a5b0-4f52-b51a-b31ba5e376e0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:51.767625 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9a4e5625-a5b0-4f52-b51a-b31ba5e376e0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:51.768062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9a4e5625-a5b0-4f52-b51a-b31ba5e376e0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:51.768828 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9a4e5625-a5b0-4f52-b51a-b31ba5e376e0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:51.769254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9a4e5625-a5b0-4f52-b51a-b31ba5e376e0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:51.906160 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9a4e5625-a5b0-4f52-b51a-b31ba5e376e0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:51.914128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9a4e5625-a5b0-4f52-b51a-b31ba5e376e0 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1724 microversion: 2.1 time: 0.156868 Jan 28 20:33:51.914697 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 413/846] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:51 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:52.336771 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:52.337366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:52.343609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:52.344088 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:52.344840 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:52.345270 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:52.472912 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:52.481036 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:52.482548 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:52.483685 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0bcf1e75-68d1-4a9e-8679-b7a1fd26ff61 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.151086 Jan 28 20:33:52.484248 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 434/847] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:52 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:33:52.653725 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0ab164af-eac9-437a-b3f8-7c00d93f1363 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:52.654246 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0ab164af-eac9-437a-b3f8-7c00d93f1363 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:52.660172 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ab164af-eac9-437a-b3f8-7c00d93f1363 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:52.660651 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ab164af-eac9-437a-b3f8-7c00d93f1363 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:52.661417 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ab164af-eac9-437a-b3f8-7c00d93f1363 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:52.661843 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ab164af-eac9-437a-b3f8-7c00d93f1363 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:52.685812 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0ab164af-eac9-437a-b3f8-7c00d93f1363 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:33:52.755587 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0ab164af-eac9-437a-b3f8-7c00d93f1363 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 204 len: 0 microversion: 2.1 time: 0.211022 Jan 28 20:33:52.756173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 414/848] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:33:52 2022] DELETE /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:33:52.764181 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c46356a5-fc48-4dad-b524-7b34c8222bdb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:52.764785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c46356a5-fc48-4dad-b524-7b34c8222bdb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:52.770788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c46356a5-fc48-4dad-b524-7b34c8222bdb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:52.771227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c46356a5-fc48-4dad-b524-7b34c8222bdb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:52.771992 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c46356a5-fc48-4dad-b524-7b34c8222bdb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:52.772749 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c46356a5-fc48-4dad-b524-7b34c8222bdb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:52.905302 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c46356a5-fc48-4dad-b524-7b34c8222bdb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:52.912541 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c46356a5-fc48-4dad-b524-7b34c8222bdb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1577 microversion: 2.1 time: 0.152099 Jan 28 20:33:52.913197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 435/849] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:52 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:52.930945 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cb518d02-3f16-4fe9-9261-a4baea1de071 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:52.931634 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cb518d02-3f16-4fe9-9261-a4baea1de071 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:52.938052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb518d02-3f16-4fe9-9261-a4baea1de071 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:52.938432 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb518d02-3f16-4fe9-9261-a4baea1de071 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:52.939205 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb518d02-3f16-4fe9-9261-a4baea1de071 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:52.939631 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb518d02-3f16-4fe9-9261-a4baea1de071 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:53.076716 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-cb518d02-3f16-4fe9-9261-a4baea1de071 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:53.084481 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cb518d02-3f16-4fe9-9261-a4baea1de071 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1701 microversion: 2.1 time: 0.157633 Jan 28 20:33:53.085055 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 415/850] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:52 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:53.100607 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a3325162-9e1a-4604-b1d1-32aeeb6a93e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:53.106437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a3325162-9e1a-4604-b1d1-32aeeb6a93e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:53.106878 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a3325162-9e1a-4604-b1d1-32aeeb6a93e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:53.128220 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a3325162-9e1a-4604-b1d1-32aeeb6a93e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Going to try to start instance {{(pid=116276) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 20:33:53.168409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a3325162-9e1a-4604-b1d1-32aeeb6a93e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/action" status: 202 len: 0 microversion: 2.1 time: 0.071317 Jan 28 20:33:53.169126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 436/851] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:33:53 2022] POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 20:33:53.177014 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-57cc9f5d-d93f-49e1-a9c6-9b794e8eb5f8 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:53.177674 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-57cc9f5d-d93f-49e1-a9c6-9b794e8eb5f8 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:53.184263 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57cc9f5d-d93f-49e1-a9c6-9b794e8eb5f8 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:53.184796 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57cc9f5d-d93f-49e1-a9c6-9b794e8eb5f8 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:53.185811 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57cc9f5d-d93f-49e1-a9c6-9b794e8eb5f8 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:53.186312 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-57cc9f5d-d93f-49e1-a9c6-9b794e8eb5f8 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:53.317704 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-57cc9f5d-d93f-49e1-a9c6-9b794e8eb5f8 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:53.325605 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-57cc9f5d-d93f-49e1-a9c6-9b794e8eb5f8 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1710 microversion: 2.1 time: 0.152196 Jan 28 20:33:53.326202 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 416/852] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:53 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:33:53.502486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:53.503227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:53.510621 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:53.511093 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:53.511879 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:53.512354 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:53.649065 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:53.657093 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:53.658744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:53.659887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e390a8ab-b671-426d-a543-7c97492317b5 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.161929 Jan 28 20:33:53.660462 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 437/853] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:53 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:53.929430 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6b1ff252-b72a-4c58-a19f-2b32d306d444 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:53.930066 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6b1ff252-b72a-4c58-a19f-2b32d306d444 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:53.936296 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6b1ff252-b72a-4c58-a19f-2b32d306d444 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:53.936876 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6b1ff252-b72a-4c58-a19f-2b32d306d444 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:53.937483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6b1ff252-b72a-4c58-a19f-2b32d306d444 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:53.937981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6b1ff252-b72a-4c58-a19f-2b32d306d444 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:54.070063 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6b1ff252-b72a-4c58-a19f-2b32d306d444 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:54.077294 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6b1ff252-b72a-4c58-a19f-2b32d306d444 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1577 microversion: 2.1 time: 0.151970 Jan 28 20:33:54.077858 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 417/854] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:53 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:54.343234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d4ef9a36-90d0-484f-88c8-10f441312113 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:54.343810 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d4ef9a36-90d0-484f-88c8-10f441312113 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:54.349773 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4ef9a36-90d0-484f-88c8-10f441312113 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:54.350758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4ef9a36-90d0-484f-88c8-10f441312113 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:54.351526 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4ef9a36-90d0-484f-88c8-10f441312113 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:54.351956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4ef9a36-90d0-484f-88c8-10f441312113 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:54.486682 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d4ef9a36-90d0-484f-88c8-10f441312113 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:54.495225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d4ef9a36-90d0-484f-88c8-10f441312113 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1710 microversion: 2.1 time: 0.155641 Jan 28 20:33:54.495824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 438/855] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:54 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:54.678479 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:54.679273 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:54.685100 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:54.685550 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:54.686359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:54.686789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:54.819433 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:54.827317 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:54.828833 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:54.830005 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9c4487c1-bb3b-4d1d-8759-35649cb36a2e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.155416 Jan 28 20:33:54.830559 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 418/856] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:54 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:55.094121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bd5eb13e-15ce-47ba-939f-4edcc554da60 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:55.094756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bd5eb13e-15ce-47ba-939f-4edcc554da60 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:55.101703 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bd5eb13e-15ce-47ba-939f-4edcc554da60 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:55.102177 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bd5eb13e-15ce-47ba-939f-4edcc554da60 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:55.102957 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bd5eb13e-15ce-47ba-939f-4edcc554da60 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:55.103390 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bd5eb13e-15ce-47ba-939f-4edcc554da60 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:55.239873 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bd5eb13e-15ce-47ba-939f-4edcc554da60 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:55.247431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bd5eb13e-15ce-47ba-939f-4edcc554da60 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1577 microversion: 2.1 time: 0.156942 Jan 28 20:33:55.247997 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 439/857] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:55 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:55.512607 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f79b1484-e016-40f0-a8ae-b304d1ae66c4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:55.513151 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f79b1484-e016-40f0-a8ae-b304d1ae66c4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:55.519917 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f79b1484-e016-40f0-a8ae-b304d1ae66c4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:55.520357 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f79b1484-e016-40f0-a8ae-b304d1ae66c4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:55.521145 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f79b1484-e016-40f0-a8ae-b304d1ae66c4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:55.521579 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f79b1484-e016-40f0-a8ae-b304d1ae66c4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:55.666937 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f79b1484-e016-40f0-a8ae-b304d1ae66c4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:55.675138 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f79b1484-e016-40f0-a8ae-b304d1ae66c4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1714 microversion: 2.1 time: 0.166231 Jan 28 20:33:55.675717 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 419/858] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:55 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1714 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:55.820433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-5754b571-9161-40a0-9036-49aea1b9cfa2 req-3cd7c169-76c8-47b0-bd30-4156c1558176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3427e95-2a32-4161-ad46-076cf02f603d", "name": "network-vif-deleted", "tag": "c5693d83-b5f3-413b-a2a5-d05a5cb7e05a"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:55.823880 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:33:55.823880 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:33:55.832030 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-5754b571-9161-40a0-9036-49aea1b9cfa2 req-3cd7c169-76c8-47b0-bd30-4156c1558176 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:55.832227 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-5754b571-9161-40a0-9036-49aea1b9cfa2 req-3cd7c169-76c8-47b0-bd30-4156c1558176 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:55.845269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-5754b571-9161-40a0-9036-49aea1b9cfa2 req-3cd7c169-76c8-47b0-bd30-4156c1558176 service nova] Creating event network-vif-deleted:c5693d83-b5f3-413b-a2a5-d05a5cb7e05a for instance e3427e95-2a32-4161-ad46-076cf02f603d on hv-cinder-82635 Jan 28 20:33:55.848254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:55.848873 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:55.851129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-5754b571-9161-40a0-9036-49aea1b9cfa2 req-3cd7c169-76c8-47b0-bd30-4156c1558176 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038968 Jan 28 20:33:55.852237 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 440/859] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:33:55.864504 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:55.864959 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:55.865810 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:55.866790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:56.007258 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:56.020463 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:56.021952 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:56.023894 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-72039adc-ba6e-4967-80f5-0d4a61239503 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.179218 Jan 28 20:33:56.024463 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 420/860] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:55 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:56.266727 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:56.267531 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:56.274493 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:56.274857 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:56.275651 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:56.276080 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:56.309975 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:56.310420 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:56.310869 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lazy-loading 'fault' on Instance uuid e3427e95-2a32-4161-ad46-076cf02f603d {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:33:56.352527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:56.360303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e64d4f46-8880-4195-8c72-a6d88bc36cd2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 200 len: 1231 microversion: 2.1 time: 0.097871 Jan 28 20:33:56.361068 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 441/861] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:56 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:57.042455 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:57.043062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:57.049358 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:57.049803 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:57.050609 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:57.051037 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:57.186812 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:57.194582 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:57.196183 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:57.197322 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9bd42eb6-b073-43ad-a70b-5a62701b84f2 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.158539 Jan 28 20:33:57.197901 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 421/862] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:57 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:33:57.377864 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cccf9e2c-8c7c-44e8-bc3d-a30ea63fa075 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:57.378421 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-cccf9e2c-8c7c-44e8-bc3d-a30ea63fa075 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:57.385090 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cccf9e2c-8c7c-44e8-bc3d-a30ea63fa075 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:57.385536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cccf9e2c-8c7c-44e8-bc3d-a30ea63fa075 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:57.386337 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cccf9e2c-8c7c-44e8-bc3d-a30ea63fa075 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:57.386770 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cccf9e2c-8c7c-44e8-bc3d-a30ea63fa075 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:57.400149 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-cccf9e2c-8c7c-44e8-bc3d-a30ea63fa075 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] HTTP exception thrown: Instance e3427e95-2a32-4161-ad46-076cf02f603d could not be found. Jan 28 20:33:57.400705 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cccf9e2c-8c7c-44e8-bc3d-a30ea63fa075 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Returning 404 to user: Instance e3427e95-2a32-4161-ad46-076cf02f603d could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:33:57.401504 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-cccf9e2c-8c7c-44e8-bc3d-a30ea63fa075 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 404 len: 111 microversion: 2.1 time: 0.027462 Jan 28 20:33:57.402048 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 442/863] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:57 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:33:57.500147 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1148556429", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1067414585", "security_groups": [{"name": "tempest-secgroup-smoke-35562867"}], "block_device_mapping_v2": [{"uuid": "2ccdf64f-e6e2-4857-8f93-a5593e93ea89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4706b4ac-208e-49dd-94bd-78970bce488d"}]}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:57.604815 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] validate_networks() for [('4706b4ac-208e-49dd-94bd-78970bce488d', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:33:58.010320 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:33:58.010734 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:33:58.011194 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:33:58.011594 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:33:58.012096 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:33:58.020639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:58.021074 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:58.021889 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:58.022584 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:58.039269 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:33:58.043076 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for user daa1f16966e94f0fb861bf124bbc0aac and project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:33:58.096301 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:33:58.098422 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ccdf64f-e6e2-4857-8f93-a5593e93ea89',volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:33:58.215613 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-168d2201-e720-4ce8-bedb-a4cd5369d02e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.719112 Jan 28 20:33:58.216388 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 422/864] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:33:57 2022] POST /compute/v2.1/servers => generated 404 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:33:58.216754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:58.217461 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:58.224140 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:58.224590 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:58.225525 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:58.225968 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ce447295-833c-44f3-af33-9f40a1df6da2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:58.226182 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:58.226725 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ce447295-833c-44f3-af33-9f40a1df6da2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:58.307473 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ce447295-833c-44f3-af33-9f40a1df6da2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:58.314708 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ce447295-833c-44f3-af33-9f40a1df6da2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1095 microversion: 2.1 time: 0.092482 Jan 28 20:33:58.315285 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 423/865] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:58 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:33:58.612699 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:58.620577 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:58.622374 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:58.623535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-cfc9a6d1-3b2a-465a-b9ca-c5cd0a0b0e7e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.411607 Jan 28 20:33:58.624085 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 443/866] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:58 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 20:33:58.785630 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-a3a8b7a2-f078-4e51-8640-146ee11e7e02 req-451b239f-a37f-415c-b425-7237bde7ba2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc7cc38-742f-4269-8cb6-7cf3e97f1654", "name": "network-vif-plugged", "status": "completed", "tag": "2b3708de-bc79-4020-8e5f-b6aecdd43ef2"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:33:58.788289 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:33:58.788289 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:33:58.796096 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-a3a8b7a2-f078-4e51-8640-146ee11e7e02 req-451b239f-a37f-415c-b425-7237bde7ba2e service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:58.797031 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-a3a8b7a2-f078-4e51-8640-146ee11e7e02 req-451b239f-a37f-415c-b425-7237bde7ba2e service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:58.809836 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-a3a8b7a2-f078-4e51-8640-146ee11e7e02 req-451b239f-a37f-415c-b425-7237bde7ba2e service nova] Creating event network-vif-plugged:2b3708de-bc79-4020-8e5f-b6aecdd43ef2 for instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 on hv-cinder-82635 Jan 28 20:33:58.815000 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-a3a8b7a2-f078-4e51-8640-146ee11e7e02 req-451b239f-a37f-415c-b425-7237bde7ba2e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032911 Jan 28 20:33:58.815737 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 424/867] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:33:59.331904 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-54c3297a-b8d0-4de5-95ec-b8aea0dc1e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:59.332429 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-54c3297a-b8d0-4de5-95ec-b8aea0dc1e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:59.338342 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-54c3297a-b8d0-4de5-95ec-b8aea0dc1e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:59.338778 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-54c3297a-b8d0-4de5-95ec-b8aea0dc1e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:59.339553 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-54c3297a-b8d0-4de5-95ec-b8aea0dc1e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:59.339988 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-54c3297a-b8d0-4de5-95ec-b8aea0dc1e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:59.398770 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-54c3297a-b8d0-4de5-95ec-b8aea0dc1e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:59.405898 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-54c3297a-b8d0-4de5-95ec-b8aea0dc1e6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1193 microversion: 2.1 time: 0.077689 Jan 28 20:33:59.406482 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 444/868] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:33:59 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1193 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:33:59.643247 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:33:59.644119 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:33:59.650775 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:59.651990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:59.652947 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:33:59.653388 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:33:59.789239 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:59.797903 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:59.799390 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:33:59.800534 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-fd5dd5cc-6a49-4f45-928b-a7905c55f0de tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.161918 Jan 28 20:33:59.801091 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 425/869] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:33:59 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:34:00.423459 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-680cd8cb-d3f8-4b1c-a9e1-dc176960edc4 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:00.424254 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-680cd8cb-d3f8-4b1c-a9e1-dc176960edc4 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:00.430588 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-680cd8cb-d3f8-4b1c-a9e1-dc176960edc4 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:00.431112 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-680cd8cb-d3f8-4b1c-a9e1-dc176960edc4 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:00.431964 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-680cd8cb-d3f8-4b1c-a9e1-dc176960edc4 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:00.432465 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-680cd8cb-d3f8-4b1c-a9e1-dc176960edc4 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:00.594629 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-680cd8cb-d3f8-4b1c-a9e1-dc176960edc4 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:00.605831 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-680cd8cb-d3f8-4b1c-a9e1-dc176960edc4 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.185753 Jan 28 20:34:00.606753 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 445/870] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:00 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:00.823718 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-87783178-f2d0-4585-8bde-87199f997339 req-62720f64-f622-49ca-84c7-44f3252833a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e", "tag": "e0e17f6c-bd50-483e-9bf1-112ff384b05a"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:34:00.826071 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:00.828874 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:34:00.828874 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:34:00.832344 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:00.853972 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-87783178-f2d0-4585-8bde-87199f997339 req-62720f64-f622-49ca-84c7-44f3252833a6 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:00.856469 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:00.858279 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:00.860267 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:00.861100 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:00.868113 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-87783178-f2d0-4585-8bde-87199f997339 req-62720f64-f622-49ca-84c7-44f3252833a6 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:00.891335 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-87783178-f2d0-4585-8bde-87199f997339 req-62720f64-f622-49ca-84c7-44f3252833a6 service nova] Creating event network-changed:e0e17f6c-bd50-483e-9bf1-112ff384b05a for instance 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e on hv-cinder-82635 Jan 28 20:34:00.898359 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-87783178-f2d0-4585-8bde-87199f997339 req-62720f64-f622-49ca-84c7-44f3252833a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077389 Jan 28 20:34:00.899542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 446/871] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:34:01.063626 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:01.071506 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:01.073287 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:01.074600 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-91504fdf-2432-47b4-8c43-ebbcde4e8f75 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1729 microversion: 2.20 time: 0.259976 Jan 28 20:34:01.075155 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 426/872] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:34:00 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:34:01.625799 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bac9e591-2843-416f-bc2f-1d86b41947d0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:01.626528 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bac9e591-2843-416f-bc2f-1d86b41947d0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:01.634042 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bac9e591-2843-416f-bc2f-1d86b41947d0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:01.634535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bac9e591-2843-416f-bc2f-1d86b41947d0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:01.635277 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bac9e591-2843-416f-bc2f-1d86b41947d0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:01.635713 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bac9e591-2843-416f-bc2f-1d86b41947d0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:01.773051 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-bac9e591-2843-416f-bc2f-1d86b41947d0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:01.780270 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bac9e591-2843-416f-bc2f-1d86b41947d0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.160878 Jan 28 20:34:01.780843 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 447/873] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:01 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:02.092291 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:02.092900 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:02.099286 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:02.099741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:02.100566 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:02.101003 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:02.235221 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:02.243403 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:02.244821 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:02.245986 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e80241d6-8b3e-4eed-bcda-35e752378905 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1716 microversion: 2.20 time: 0.157379 Jan 28 20:34:02.246547 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 427/874] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:34:02 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:34:02.798131 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-956f747e-df0e-4d31-8398-8207c903f100 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:02.798736 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-956f747e-df0e-4d31-8398-8207c903f100 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:02.805209 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-956f747e-df0e-4d31-8398-8207c903f100 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:02.805607 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-956f747e-df0e-4d31-8398-8207c903f100 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:02.806410 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-956f747e-df0e-4d31-8398-8207c903f100 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:02.806842 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-956f747e-df0e-4d31-8398-8207c903f100 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:02.939213 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-956f747e-df0e-4d31-8398-8207c903f100 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:02.946962 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-956f747e-df0e-4d31-8398-8207c903f100 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.152521 Jan 28 20:34:02.947532 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 448/875] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:02 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:03.963347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-149abb0d-b1ef-4ea2-bfc5-a174b15018db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:03.963951 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-149abb0d-b1ef-4ea2-bfc5-a174b15018db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:03.970325 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-149abb0d-b1ef-4ea2-bfc5-a174b15018db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:03.970780 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-149abb0d-b1ef-4ea2-bfc5-a174b15018db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:03.971554 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-149abb0d-b1ef-4ea2-bfc5-a174b15018db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:03.971988 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-149abb0d-b1ef-4ea2-bfc5-a174b15018db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:04.117107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-149abb0d-b1ef-4ea2-bfc5-a174b15018db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:04.124218 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-149abb0d-b1ef-4ea2-bfc5-a174b15018db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.164508 Jan 28 20:34:04.124777 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 428/876] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:03 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:05.140834 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-577c5625-24c6-4e46-83b1-d987e0fdcf67 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:05.141434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-577c5625-24c6-4e46-83b1-d987e0fdcf67 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:05.148139 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-577c5625-24c6-4e46-83b1-d987e0fdcf67 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:05.148576 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-577c5625-24c6-4e46-83b1-d987e0fdcf67 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:05.149342 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-577c5625-24c6-4e46-83b1-d987e0fdcf67 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:05.149766 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-577c5625-24c6-4e46-83b1-d987e0fdcf67 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:05.283520 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-577c5625-24c6-4e46-83b1-d987e0fdcf67 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:05.290716 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-577c5625-24c6-4e46-83b1-d987e0fdcf67 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.153514 Jan 28 20:34:05.291291 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 449/877] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:05 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:06.307754 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5ea945a9-078c-4010-bea2-3e217451bd05 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:06.308364 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5ea945a9-078c-4010-bea2-3e217451bd05 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:06.314710 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5ea945a9-078c-4010-bea2-3e217451bd05 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:06.315165 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5ea945a9-078c-4010-bea2-3e217451bd05 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:06.315946 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5ea945a9-078c-4010-bea2-3e217451bd05 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:06.316380 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5ea945a9-078c-4010-bea2-3e217451bd05 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:06.451006 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5ea945a9-078c-4010-bea2-3e217451bd05 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:06.458196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5ea945a9-078c-4010-bea2-3e217451bd05 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.154107 Jan 28 20:34:06.458761 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 429/878] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:06 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:07.475303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1b215d37-270b-4406-a8a0-c38d6bf560d2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:07.475914 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1b215d37-270b-4406-a8a0-c38d6bf560d2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:07.482160 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b215d37-270b-4406-a8a0-c38d6bf560d2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:07.482606 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b215d37-270b-4406-a8a0-c38d6bf560d2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:07.483373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b215d37-270b-4406-a8a0-c38d6bf560d2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:07.483805 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b215d37-270b-4406-a8a0-c38d6bf560d2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:07.761307 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1b215d37-270b-4406-a8a0-c38d6bf560d2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:07.768454 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1b215d37-270b-4406-a8a0-c38d6bf560d2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.296851 Jan 28 20:34:07.769018 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 450/879] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:07 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:08.785240 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b6c7cb34-982d-4f43-8456-812f9215ee7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:08.785848 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b6c7cb34-982d-4f43-8456-812f9215ee7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:08.792738 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b6c7cb34-982d-4f43-8456-812f9215ee7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:08.793192 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b6c7cb34-982d-4f43-8456-812f9215ee7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:08.794004 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b6c7cb34-982d-4f43-8456-812f9215ee7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:08.794442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b6c7cb34-982d-4f43-8456-812f9215ee7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:08.928363 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b6c7cb34-982d-4f43-8456-812f9215ee7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:08.936347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b6c7cb34-982d-4f43-8456-812f9215ee7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.154670 Jan 28 20:34:08.936935 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 430/880] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:08 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:09.952393 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7d9f3b53-d537-408d-a3c6-9fb3a1a95f39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:09.953019 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7d9f3b53-d537-408d-a3c6-9fb3a1a95f39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:09.959316 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7d9f3b53-d537-408d-a3c6-9fb3a1a95f39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:09.959763 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7d9f3b53-d537-408d-a3c6-9fb3a1a95f39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:09.960542 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7d9f3b53-d537-408d-a3c6-9fb3a1a95f39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:09.961530 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7d9f3b53-d537-408d-a3c6-9fb3a1a95f39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:10.102582 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7d9f3b53-d537-408d-a3c6-9fb3a1a95f39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:10.109756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7d9f3b53-d537-408d-a3c6-9fb3a1a95f39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.161046 Jan 28 20:34:10.110322 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 451/881] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:09 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:11.126909 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-77f43a43-b246-45d3-a5c5-826f86891ea3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:11.127514 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-77f43a43-b246-45d3-a5c5-826f86891ea3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:11.134312 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-77f43a43-b246-45d3-a5c5-826f86891ea3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:11.134755 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-77f43a43-b246-45d3-a5c5-826f86891ea3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:11.135539 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-77f43a43-b246-45d3-a5c5-826f86891ea3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:11.135950 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-77f43a43-b246-45d3-a5c5-826f86891ea3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:11.269039 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-77f43a43-b246-45d3-a5c5-826f86891ea3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:11.276406 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-77f43a43-b246-45d3-a5c5-826f86891ea3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.153430 Jan 28 20:34:11.276970 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 431/882] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:11 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:11.434683 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:34:11.435251 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: Fri Jan 28 20:34:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:34:12.293455 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-98049762-994a-493a-848e-8a517086e5db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:12.294079 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-98049762-994a-493a-848e-8a517086e5db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:12.300052 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-98049762-994a-493a-848e-8a517086e5db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:12.300497 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-98049762-994a-493a-848e-8a517086e5db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:12.301269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-98049762-994a-493a-848e-8a517086e5db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:12.301699 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-98049762-994a-493a-848e-8a517086e5db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:12.435593 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-98049762-994a-493a-848e-8a517086e5db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:12.442813 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-98049762-994a-493a-848e-8a517086e5db tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.153081 Jan 28 20:34:12.443376 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 452/883] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:12 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:12.882451 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-1cdd1bb4-58b8-408c-ad1b-ae173e76a657 req-63437c15-261e-481a-ac5b-3b8425fc40e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e", "name": "network-vif-plugged", "status": "completed", "tag": "e0e17f6c-bd50-483e-9bf1-112ff384b05a"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:34:12.884483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:34:12.884483 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:34:12.891680 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-1cdd1bb4-58b8-408c-ad1b-ae173e76a657 req-63437c15-261e-481a-ac5b-3b8425fc40e5 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:12.892154 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-1cdd1bb4-58b8-408c-ad1b-ae173e76a657 req-63437c15-261e-481a-ac5b-3b8425fc40e5 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:12.903889 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-1cdd1bb4-58b8-408c-ad1b-ae173e76a657 req-63437c15-261e-481a-ac5b-3b8425fc40e5 service nova] Creating event network-vif-plugged:e0e17f6c-bd50-483e-9bf1-112ff384b05a for instance 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e on hv-cinder-82635 Jan 28 20:34:12.909310 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-1cdd1bb4-58b8-408c-ad1b-ae173e76a657 req-63437c15-261e-481a-ac5b-3b8425fc40e5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030417 Jan 28 20:34:12.909939 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 432/884] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:34:13.459955 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-765715f9-51cc-43c6-a34e-df0af3681b6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:13.460570 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-765715f9-51cc-43c6-a34e-df0af3681b6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:13.466756 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-765715f9-51cc-43c6-a34e-df0af3681b6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:13.467214 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-765715f9-51cc-43c6-a34e-df0af3681b6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:13.467994 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-765715f9-51cc-43c6-a34e-df0af3681b6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:13.468427 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-765715f9-51cc-43c6-a34e-df0af3681b6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:13.598955 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-765715f9-51cc-43c6-a34e-df0af3681b6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:13.606852 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-765715f9-51cc-43c6-a34e-df0af3681b6d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.150668 Jan 28 20:34:13.607407 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 453/885] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:13 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:14.624699 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1d199c8d-2957-4170-8439-dc036564b0bf tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:14.625444 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1d199c8d-2957-4170-8439-dc036564b0bf tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:14.631408 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1d199c8d-2957-4170-8439-dc036564b0bf tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:14.631855 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1d199c8d-2957-4170-8439-dc036564b0bf tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:14.633296 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1d199c8d-2957-4170-8439-dc036564b0bf tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:14.633765 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1d199c8d-2957-4170-8439-dc036564b0bf tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:14.773196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1d199c8d-2957-4170-8439-dc036564b0bf tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:14.780396 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1d199c8d-2957-4170-8439-dc036564b0bf tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1265 microversion: 2.1 time: 0.160448 Jan 28 20:34:14.780959 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 433/886] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:14 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:15.797133 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2749644e-056d-4c2e-8104-c5b3ecc00b99 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:15.797906 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2749644e-056d-4c2e-8104-c5b3ecc00b99 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:15.804171 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2749644e-056d-4c2e-8104-c5b3ecc00b99 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:15.804622 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2749644e-056d-4c2e-8104-c5b3ecc00b99 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:15.805431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2749644e-056d-4c2e-8104-c5b3ecc00b99 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:15.805865 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2749644e-056d-4c2e-8104-c5b3ecc00b99 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:15.942308 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2749644e-056d-4c2e-8104-c5b3ecc00b99 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:15.950364 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2749644e-056d-4c2e-8104-c5b3ecc00b99 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1452 microversion: 2.1 time: 0.156865 Jan 28 20:34:15.950940 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 454/887] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:15 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:15.966974 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-055b34f1-e508-4821-b73a-3e143bfa7d01 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:15.967587 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-055b34f1-e508-4821-b73a-3e143bfa7d01 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:15.973942 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-055b34f1-e508-4821-b73a-3e143bfa7d01 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:15.974395 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-055b34f1-e508-4821-b73a-3e143bfa7d01 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:15.975180 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-055b34f1-e508-4821-b73a-3e143bfa7d01 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:15.975622 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-055b34f1-e508-4821-b73a-3e143bfa7d01 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:16.111620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-055b34f1-e508-4821-b73a-3e143bfa7d01 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:16.118865 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-055b34f1-e508-4821-b73a-3e143bfa7d01 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1452 microversion: 2.1 time: 0.155585 Jan 28 20:34:16.119425 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 434/888] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:15 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:17.750822 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-679d9c22-778a-409c-8536-f35142b1951c req-d2d1e12d-51eb-48f0-b500-3e3d9f16dc90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e", "tag": "e0e17f6c-bd50-483e-9bf1-112ff384b05a"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:34:17.752325 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:34:17.752325 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:34:17.759469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-679d9c22-778a-409c-8536-f35142b1951c req-d2d1e12d-51eb-48f0-b500-3e3d9f16dc90 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:17.759927 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-679d9c22-778a-409c-8536-f35142b1951c req-d2d1e12d-51eb-48f0-b500-3e3d9f16dc90 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:17.770314 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-679d9c22-778a-409c-8536-f35142b1951c req-d2d1e12d-51eb-48f0-b500-3e3d9f16dc90 service nova] Creating event network-changed:e0e17f6c-bd50-483e-9bf1-112ff384b05a for instance 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e on hv-cinder-82635 Jan 28 20:34:17.775966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-679d9c22-778a-409c-8536-f35142b1951c req-d2d1e12d-51eb-48f0-b500-3e3d9f16dc90 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028774 Jan 28 20:34:17.776540 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 455/889] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:34:38.042878 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0bdeebdc-44a5-47d0-8456-437004757ece tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:34:38.043819 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0bdeebdc-44a5-47d0-8456-437004757ece tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:38.050186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0bdeebdc-44a5-47d0-8456-437004757ece tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:38.050641 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0bdeebdc-44a5-47d0-8456-437004757ece tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:38.051592 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0bdeebdc-44a5-47d0-8456-437004757ece tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:38.052111 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0bdeebdc-44a5-47d0-8456-437004757ece tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:38.121859 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0bdeebdc-44a5-47d0-8456-437004757ece tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "POST /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/action" status: 202 len: 0 microversion: 2.1 time: 0.082602 Jan 28 20:34:38.122540 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 435/890] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:34:38 2022] POST /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:34:38.131715 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a5e13272-6066-4471-a352-87ef1616d935 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:38.132464 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a5e13272-6066-4471-a352-87ef1616d935 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:38.139547 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a5e13272-6066-4471-a352-87ef1616d935 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:38.139993 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a5e13272-6066-4471-a352-87ef1616d935 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:38.140823 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a5e13272-6066-4471-a352-87ef1616d935 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:38.141449 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a5e13272-6066-4471-a352-87ef1616d935 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:38.294948 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a5e13272-6066-4471-a352-87ef1616d935 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:38.302684 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a5e13272-6066-4471-a352-87ef1616d935 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1752 microversion: 2.1 time: 0.175459 Jan 28 20:34:38.303773 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 456/891] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:38 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:39.323175 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-476b7251-38f2-457d-a379-375a5c8eb61b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:39.323801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-476b7251-38f2-457d-a379-375a5c8eb61b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:39.330210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-476b7251-38f2-457d-a379-375a5c8eb61b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:39.330662 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-476b7251-38f2-457d-a379-375a5c8eb61b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:39.331435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-476b7251-38f2-457d-a379-375a5c8eb61b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:39.331869 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-476b7251-38f2-457d-a379-375a5c8eb61b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:39.482382 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-476b7251-38f2-457d-a379-375a5c8eb61b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:39.490164 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-476b7251-38f2-457d-a379-375a5c8eb61b tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.171549 Jan 28 20:34:39.490729 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 436/892] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:39 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:40.507985 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-178622f7-bb76-40c1-8055-20b339d2049a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:40.508594 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-178622f7-bb76-40c1-8055-20b339d2049a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:40.514881 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-178622f7-bb76-40c1-8055-20b339d2049a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:40.515330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-178622f7-bb76-40c1-8055-20b339d2049a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:40.516095 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-178622f7-bb76-40c1-8055-20b339d2049a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:40.516524 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-178622f7-bb76-40c1-8055-20b339d2049a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:40.660084 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-178622f7-bb76-40c1-8055-20b339d2049a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:40.668608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-178622f7-bb76-40c1-8055-20b339d2049a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.164820 Jan 28 20:34:40.669383 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 457/893] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:40 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:41.685285 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-531af2ff-506a-4c57-9c65-15165b8e3022 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:41.685907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-531af2ff-506a-4c57-9c65-15165b8e3022 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:41.692163 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-531af2ff-506a-4c57-9c65-15165b8e3022 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:41.692605 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-531af2ff-506a-4c57-9c65-15165b8e3022 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:41.693368 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-531af2ff-506a-4c57-9c65-15165b8e3022 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:41.693796 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-531af2ff-506a-4c57-9c65-15165b8e3022 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:41.840085 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-531af2ff-506a-4c57-9c65-15165b8e3022 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:41.847777 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-531af2ff-506a-4c57-9c65-15165b8e3022 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.166128 Jan 28 20:34:41.848339 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 437/894] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:41 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:42.864415 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-20b1a666-79bf-4d9c-b2c0-835b1a386a5c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:42.865025 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-20b1a666-79bf-4d9c-b2c0-835b1a386a5c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:42.871550 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-20b1a666-79bf-4d9c-b2c0-835b1a386a5c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:42.872000 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-20b1a666-79bf-4d9c-b2c0-835b1a386a5c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:42.872779 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-20b1a666-79bf-4d9c-b2c0-835b1a386a5c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:42.873213 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-20b1a666-79bf-4d9c-b2c0-835b1a386a5c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:43.015854 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-20b1a666-79bf-4d9c-b2c0-835b1a386a5c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:43.024469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-20b1a666-79bf-4d9c-b2c0-835b1a386a5c tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.163821 Jan 28 20:34:43.025032 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 458/895] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:42 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:44.041580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-32f457eb-368d-4886-b58b-dc6793e7a8dd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:44.042221 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-32f457eb-368d-4886-b58b-dc6793e7a8dd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:44.048602 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-32f457eb-368d-4886-b58b-dc6793e7a8dd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:44.049049 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-32f457eb-368d-4886-b58b-dc6793e7a8dd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:44.049825 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-32f457eb-368d-4886-b58b-dc6793e7a8dd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:44.050302 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-32f457eb-368d-4886-b58b-dc6793e7a8dd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:44.193089 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-32f457eb-368d-4886-b58b-dc6793e7a8dd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:44.202047 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-32f457eb-368d-4886-b58b-dc6793e7a8dd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.164821 Jan 28 20:34:44.202617 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 438/896] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:44 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:45.218347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0ba861bd-7a81-44e0-8b9f-1e74c8b69619 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:45.218948 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0ba861bd-7a81-44e0-8b9f-1e74c8b69619 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:45.225132 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ba861bd-7a81-44e0-8b9f-1e74c8b69619 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:45.225579 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ba861bd-7a81-44e0-8b9f-1e74c8b69619 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:45.226886 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ba861bd-7a81-44e0-8b9f-1e74c8b69619 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:45.227325 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ba861bd-7a81-44e0-8b9f-1e74c8b69619 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:45.372770 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0ba861bd-7a81-44e0-8b9f-1e74c8b69619 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:45.380583 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0ba861bd-7a81-44e0-8b9f-1e74c8b69619 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.165893 Jan 28 20:34:45.381148 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 459/897] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:45 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:46.397547 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-eb0f9b9e-6877-493f-b2fc-959a9b2268fd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:46.398254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-eb0f9b9e-6877-493f-b2fc-959a9b2268fd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:46.404526 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-eb0f9b9e-6877-493f-b2fc-959a9b2268fd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:46.404973 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-eb0f9b9e-6877-493f-b2fc-959a9b2268fd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:46.405745 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-eb0f9b9e-6877-493f-b2fc-959a9b2268fd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:46.406216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-eb0f9b9e-6877-493f-b2fc-959a9b2268fd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:46.545549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-eb0f9b9e-6877-493f-b2fc-959a9b2268fd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:46.553194 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-eb0f9b9e-6877-493f-b2fc-959a9b2268fd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.159542 Jan 28 20:34:46.553762 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 439/898] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:46 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:47.570453 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4d2d8aa4-68e5-4fe5-b605-42065216eb30 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:47.571061 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4d2d8aa4-68e5-4fe5-b605-42065216eb30 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:47.577366 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4d2d8aa4-68e5-4fe5-b605-42065216eb30 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:47.577811 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4d2d8aa4-68e5-4fe5-b605-42065216eb30 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:47.578618 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4d2d8aa4-68e5-4fe5-b605-42065216eb30 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:47.579050 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4d2d8aa4-68e5-4fe5-b605-42065216eb30 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:47.722931 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-4d2d8aa4-68e5-4fe5-b605-42065216eb30 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:47.731321 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4d2d8aa4-68e5-4fe5-b605-42065216eb30 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.164500 Jan 28 20:34:47.731882 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 460/899] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:47 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:48.748282 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-050274b9-3454-41c1-ab93-8e0d94e20468 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:48.748947 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-050274b9-3454-41c1-ab93-8e0d94e20468 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:48.755104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-050274b9-3454-41c1-ab93-8e0d94e20468 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:48.755574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-050274b9-3454-41c1-ab93-8e0d94e20468 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:48.756347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-050274b9-3454-41c1-ab93-8e0d94e20468 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:48.756781 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-050274b9-3454-41c1-ab93-8e0d94e20468 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:48.899640 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-050274b9-3454-41c1-ab93-8e0d94e20468 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:48.907839 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-050274b9-3454-41c1-ab93-8e0d94e20468 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.163222 Jan 28 20:34:48.908416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 440/900] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:48 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:49.924557 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-01f09c18-8821-43fd-8570-06898b0256cd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:49.925135 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-01f09c18-8821-43fd-8570-06898b0256cd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:49.932136 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-01f09c18-8821-43fd-8570-06898b0256cd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:49.932574 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-01f09c18-8821-43fd-8570-06898b0256cd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:49.933340 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-01f09c18-8821-43fd-8570-06898b0256cd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:49.933760 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-01f09c18-8821-43fd-8570-06898b0256cd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:50.095198 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-01f09c18-8821-43fd-8570-06898b0256cd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:50.103920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-01f09c18-8821-43fd-8570-06898b0256cd tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.183018 Jan 28 20:34:50.104520 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 461/901] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:49 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:51.121160 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f1d12e32-f2ec-4307-88ce-a4a9ab23f31f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:51.121768 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f1d12e32-f2ec-4307-88ce-a4a9ab23f31f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:51.127767 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f1d12e32-f2ec-4307-88ce-a4a9ab23f31f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:51.128216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f1d12e32-f2ec-4307-88ce-a4a9ab23f31f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:51.128984 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f1d12e32-f2ec-4307-88ce-a4a9ab23f31f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:51.129416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f1d12e32-f2ec-4307-88ce-a4a9ab23f31f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:51.276219 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f1d12e32-f2ec-4307-88ce-a4a9ab23f31f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:51.283930 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f1d12e32-f2ec-4307-88ce-a4a9ab23f31f tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.167033 Jan 28 20:34:51.284493 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 441/902] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:51 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:52.300189 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c13205b8-c6bb-4679-8c72-959dd0b369d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:52.300807 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c13205b8-c6bb-4679-8c72-959dd0b369d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:52.306971 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c13205b8-c6bb-4679-8c72-959dd0b369d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:52.307410 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c13205b8-c6bb-4679-8c72-959dd0b369d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:52.308197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c13205b8-c6bb-4679-8c72-959dd0b369d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:52.308621 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c13205b8-c6bb-4679-8c72-959dd0b369d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:52.457133 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c13205b8-c6bb-4679-8c72-959dd0b369d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:52.464767 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c13205b8-c6bb-4679-8c72-959dd0b369d3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.168186 Jan 28 20:34:52.465326 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 462/903] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:52 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:53.531479 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a3643884-754b-41c9-bc00-995abec96de3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:53.532093 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a3643884-754b-41c9-bc00-995abec96de3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:53.538349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a3643884-754b-41c9-bc00-995abec96de3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:53.538801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a3643884-754b-41c9-bc00-995abec96de3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:53.539579 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a3643884-754b-41c9-bc00-995abec96de3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:53.540014 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a3643884-754b-41c9-bc00-995abec96de3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:53.684293 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a3643884-754b-41c9-bc00-995abec96de3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:53.692569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a3643884-754b-41c9-bc00-995abec96de3 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1757 microversion: 2.1 time: 0.164772 Jan 28 20:34:53.693169 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 442/904] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:53 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:34:54.709117 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c1712a82-f072-4848-a1e8-1bdc0e651201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:34:54.709731 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c1712a82-f072-4848-a1e8-1bdc0e651201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:34:54.716027 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c1712a82-f072-4848-a1e8-1bdc0e651201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:54.716471 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c1712a82-f072-4848-a1e8-1bdc0e651201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:54.717245 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c1712a82-f072-4848-a1e8-1bdc0e651201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:34:54.717675 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c1712a82-f072-4848-a1e8-1bdc0e651201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:34:54.858923 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c1712a82-f072-4848-a1e8-1bdc0e651201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:34:54.867245 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c1712a82-f072-4848-a1e8-1bdc0e651201 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1760 microversion: 2.1 time: 0.161230 Jan 28 20:34:54.867804 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 463/905] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:34:54 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1760 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:00.924727 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4bfaa158-7374-4d53-8990-a48e518532df tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:00.925685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4bfaa158-7374-4d53-8990-a48e518532df tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:00.932533 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4bfaa158-7374-4d53-8990-a48e518532df tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:00.932972 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4bfaa158-7374-4d53-8990-a48e518532df tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:00.933742 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4bfaa158-7374-4d53-8990-a48e518532df tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:00.934214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4bfaa158-7374-4d53-8990-a48e518532df tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:00.961135 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4bfaa158-7374-4d53-8990-a48e518532df tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040096 Jan 28 20:35:00.961671 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 443/906] 10.222.0.59 () {60 vars in 1342 bytes} [Fri Jan 28 20:35:00 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:01.016175 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-915ca7b9-cc8f-46c8-ab55-125e4eb7d594 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:01.016676 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-915ca7b9-cc8f-46c8-ab55-125e4eb7d594 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:01.023095 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-915ca7b9-cc8f-46c8-ab55-125e4eb7d594 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:01.023539 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-915ca7b9-cc8f-46c8-ab55-125e4eb7d594 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:01.024320 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-915ca7b9-cc8f-46c8-ab55-125e4eb7d594 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:01.024752 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-915ca7b9-cc8f-46c8-ab55-125e4eb7d594 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:01.049205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-915ca7b9-cc8f-46c8-ab55-125e4eb7d594 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:35:01.120506 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-915ca7b9-cc8f-46c8-ab55-125e4eb7d594 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 204 len: 0 microversion: 2.20 time: 0.107632 Jan 28 20:35:01.121224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 464/907] 10.222.0.59 () {60 vars in 1279 bytes} [Fri Jan 28 20:35:01 2022] DELETE /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 20:35:01.129972 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:01.130789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:01.136446 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:01.136885 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:01.137649 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:01.138107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:01.269400 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:01.278161 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:01.279642 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:01.280779 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-79be1a81-536f-428c-b28d-0a0a1c2a7849 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.154783 Jan 28 20:35:01.281331 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 444/908] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:35:01 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:35:02.300882 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:02.301689 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:02.308483 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:02.308924 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:02.309688 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:02.310223 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:02.440895 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:02.449660 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:02.451167 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:02.452327 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-5e274539-da76-42d2-b69f-e571493010cd tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.155576 Jan 28 20:35:02.452881 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 465/909] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:35:02 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:35:02.520076 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-893b2577-a6a8-41b5-8211-a9c462ee798c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:02.520594 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-893b2577-a6a8-41b5-8211-a9c462ee798c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:02.527047 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-893b2577-a6a8-41b5-8211-a9c462ee798c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:02.527495 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-893b2577-a6a8-41b5-8211-a9c462ee798c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:02.528266 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-893b2577-a6a8-41b5-8211-a9c462ee798c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:02.528692 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-893b2577-a6a8-41b5-8211-a9c462ee798c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:02.605304 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-893b2577-a6a8-41b5-8211-a9c462ee798c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lazy-loading 'services' on Instance uuid 0c701840-780a-4c1e-83e3-d03c2b53b0ed {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:35:02.672301 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-893b2577-a6a8-41b5-8211-a9c462ee798c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/os-volume_attachments/b14dc2c2-91f3-4ad3-a8df-e27817b8332e" status: 202 len: 0 microversion: 2.1 time: 0.155612 Jan 28 20:35:02.673078 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 445/910] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:35:02 2022] DELETE /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/os-volume_attachments/b14dc2c2-91f3-4ad3-a8df-e27817b8332e => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:35:03.470681 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:03.471438 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:03.478578 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:03.479449 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:03.480297 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:03.481488 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:03.617839 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:03.625890 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:03.627466 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:03.628698 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c4b55869-47b4-466e-9d9e-528ac37b6767 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1722 microversion: 2.20 time: 0.161772 Jan 28 20:35:03.629330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 466/911] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:35:03 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:35:03.776986 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1dd8164c-4ff3-44fb-b6c7-9c6c182763d2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:35:03.785726 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1dd8164c-4ff3-44fb-b6c7-9c6c182763d2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:03.786213 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1dd8164c-4ff3-44fb-b6c7-9c6c182763d2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:03.846824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1dd8164c-4ff3-44fb-b6c7-9c6c182763d2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Going to try to stop instance {{(pid=116275) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 20:35:03.891060 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1dd8164c-4ff3-44fb-b6c7-9c6c182763d2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/action" status: 202 len: 0 microversion: 2.1 time: 0.118867 Jan 28 20:35:03.892136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 446/912] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:35:03 2022] POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:35:03.900744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d4c2c81d-495d-4ffc-b6ed-0165563341e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:03.901586 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d4c2c81d-495d-4ffc-b6ed-0165563341e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:03.907585 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4c2c81d-495d-4ffc-b6ed-0165563341e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:03.908154 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4c2c81d-495d-4ffc-b6ed-0165563341e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:03.909028 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4c2c81d-495d-4ffc-b6ed-0165563341e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:03.910321 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d4c2c81d-495d-4ffc-b6ed-0165563341e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:04.054809 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-f611eb2b-8759-461d-888e-3419b480cae9 req-201125b3-5b4d-4492-b291-cbd662b86da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc7cc38-742f-4269-8cb6-7cf3e97f1654", "name": "network-vif-deleted", "tag": "2b3708de-bc79-4020-8e5f-b6aecdd43ef2"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:35:04.058713 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:35:04.058713 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:35:04.076649 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d4c2c81d-495d-4ffc-b6ed-0165563341e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:04.077272 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-f611eb2b-8759-461d-888e-3419b480cae9 req-201125b3-5b4d-4492-b291-cbd662b86da9 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:04.077745 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-f611eb2b-8759-461d-888e-3419b480cae9 req-201125b3-5b4d-4492-b291-cbd662b86da9 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:04.088918 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d4c2c81d-495d-4ffc-b6ed-0165563341e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1678 microversion: 2.1 time: 0.192301 Jan 28 20:35:04.089829 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 467/913] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:03 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:04.091164 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-f611eb2b-8759-461d-888e-3419b480cae9 req-201125b3-5b4d-4492-b291-cbd662b86da9 service nova] Creating event network-vif-deleted:2b3708de-bc79-4020-8e5f-b6aecdd43ef2 for instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 on hv-cinder-82635 Jan 28 20:35:04.103342 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-f611eb2b-8759-461d-888e-3419b480cae9 req-201125b3-5b4d-4492-b291-cbd662b86da9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055003 Jan 28 20:35:04.103874 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 447/914] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:35:04.647136 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:04.647764 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:04.654086 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:04.654726 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:04.655523 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:04.655951 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:04.689341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:04.689788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:04.690267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lazy-loading 'fault' on Instance uuid 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:35:04.732065 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:04.740740 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:04.742258 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a80b14067e3245c49fbbde4ca5f0bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269d658f0540dab6086a21ebd9e00f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:04.743790 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-742fc236-3617-4c4f-8f20-f1d2ad62706d tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 200 len: 1369 microversion: 2.20 time: 0.100843 Jan 28 20:35:04.744349 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 468/915] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:35:04 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 20:35:05.108337 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0ea63986-aa5b-4856-88c3-ff1f40599e37 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:05.109068 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0ea63986-aa5b-4856-88c3-ff1f40599e37 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:05.115127 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ea63986-aa5b-4856-88c3-ff1f40599e37 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:05.115578 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ea63986-aa5b-4856-88c3-ff1f40599e37 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:05.116892 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ea63986-aa5b-4856-88c3-ff1f40599e37 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:05.117323 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0ea63986-aa5b-4856-88c3-ff1f40599e37 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:05.249201 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-0ea63986-aa5b-4856-88c3-ff1f40599e37 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:05.256372 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0ea63986-aa5b-4856-88c3-ff1f40599e37 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1678 microversion: 2.1 time: 0.152453 Jan 28 20:35:05.257508 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 448/916] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:05 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:05.761688 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-64f6bbf3-37e4-4a95-a6a9-0f746d4a0672 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:05.762314 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-64f6bbf3-37e4-4a95-a6a9-0f746d4a0672 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:05.768540 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-64f6bbf3-37e4-4a95-a6a9-0f746d4a0672 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:05.768984 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-64f6bbf3-37e4-4a95-a6a9-0f746d4a0672 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:05.769751 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-64f6bbf3-37e4-4a95-a6a9-0f746d4a0672 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:05.770208 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-64f6bbf3-37e4-4a95-a6a9-0f746d4a0672 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:05.783370 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-64f6bbf3-37e4-4a95-a6a9-0f746d4a0672 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] HTTP exception thrown: Instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 could not be found. Jan 28 20:35:05.783926 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-64f6bbf3-37e4-4a95-a6a9-0f746d4a0672 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Returning 404 to user: Instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:35:05.784720 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-64f6bbf3-37e4-4a95-a6a9-0f746d4a0672 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 404 len: 111 microversion: 2.20 time: 0.026841 Jan 28 20:35:05.785225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 469/917] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:35:05 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 20:35:05.794185 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-93bec0de-d775-4b90-87ca-f1aa9f703e6e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '.version_select at 0x7fc7794bb9d0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:05.812247 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-93bec0de-d775-4b90-87ca-f1aa9f703e6e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006605285" status: 204 len: 0 microversion: 2.20 time: 0.021556 Jan 28 20:35:05.812843 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 449/918] 10.222.0.59 () {60 vars in 1261 bytes} [Fri Jan 28 20:35:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006605285 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 20:35:06.274286 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2f44b5f1-703a-486c-8501-4db1582cd922 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:06.274896 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2f44b5f1-703a-486c-8501-4db1582cd922 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:06.280566 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2f44b5f1-703a-486c-8501-4db1582cd922 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:06.281013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2f44b5f1-703a-486c-8501-4db1582cd922 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:06.281789 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2f44b5f1-703a-486c-8501-4db1582cd922 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:06.282251 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2f44b5f1-703a-486c-8501-4db1582cd922 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:06.427054 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2f44b5f1-703a-486c-8501-4db1582cd922 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:06.436577 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2f44b5f1-703a-486c-8501-4db1582cd922 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1678 microversion: 2.1 time: 0.166302 Jan 28 20:35:06.437292 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 470/919] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:06 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:07.453981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-59ad899d-9b9a-4a31-a9f9-0e9a0dbfae2c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:07.454603 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-59ad899d-9b9a-4a31-a9f9-0e9a0dbfae2c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:07.461011 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-59ad899d-9b9a-4a31-a9f9-0e9a0dbfae2c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:07.461462 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-59ad899d-9b9a-4a31-a9f9-0e9a0dbfae2c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:07.462268 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-59ad899d-9b9a-4a31-a9f9-0e9a0dbfae2c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:07.462705 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-59ad899d-9b9a-4a31-a9f9-0e9a0dbfae2c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:07.566625 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e1c2ac0d-546b-4efd-b3dc-5efc3d3d231e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:07.567149 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e1c2ac0d-546b-4efd-b3dc-5efc3d3d231e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:07.573763 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1c2ac0d-546b-4efd-b3dc-5efc3d3d231e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:07.574247 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1c2ac0d-546b-4efd-b3dc-5efc3d3d231e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:07.575024 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1c2ac0d-546b-4efd-b3dc-5efc3d3d231e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:07.575458 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1c2ac0d-546b-4efd-b3dc-5efc3d3d231e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:07.589083 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-e1c2ac0d-546b-4efd-b3dc-5efc3d3d231e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] HTTP exception thrown: Instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 could not be found. Jan 28 20:35:07.589798 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e1c2ac0d-546b-4efd-b3dc-5efc3d3d231e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Returning 404 to user: Instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:35:07.590631 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e1c2ac0d-546b-4efd-b3dc-5efc3d3d231e tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 404 len: 111 microversion: 2.20 time: 0.027754 Jan 28 20:35:07.591169 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 471/920] 10.222.0.59 () {60 vars in 1279 bytes} [Fri Jan 28 20:35:07 2022] DELETE /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 20:35:07.595712 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-59ad899d-9b9a-4a31-a9f9-0e9a0dbfae2c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:07.598557 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e7d21953-5cdb-45b9-9189-b84278003570 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:07.599157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e7d21953-5cdb-45b9-9189-b84278003570 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: 4bc7cc38-742f-4269-8cb6-7cf3e97f1654] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:07.603052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-59ad899d-9b9a-4a31-a9f9-0e9a0dbfae2c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1678 microversion: 2.1 time: 0.153271 Jan 28 20:35:07.604302 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 450/921] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:07 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:07.604735 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e7d21953-5cdb-45b9-9189-b84278003570 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:07.605159 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e7d21953-5cdb-45b9-9189-b84278003570 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:07.605947 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e7d21953-5cdb-45b9-9189-b84278003570 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:07.606376 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e7d21953-5cdb-45b9-9189-b84278003570 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:07.619139 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-e7d21953-5cdb-45b9-9189-b84278003570 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] HTTP exception thrown: Instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 could not be found. Jan 28 20:35:07.619701 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e7d21953-5cdb-45b9-9189-b84278003570 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Returning 404 to user: Instance 4bc7cc38-742f-4269-8cb6-7cf3e97f1654 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:35:07.620527 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e7d21953-5cdb-45b9-9189-b84278003570 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654" status: 404 len: 111 microversion: 2.20 time: 0.025399 Jan 28 20:35:07.621151 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 472/922] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:35:07 2022] GET /compute/v2.1/servers/4bc7cc38-742f-4269-8cb6-7cf3e97f1654 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 20:35:08.620231 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3455a113-a86c-4277-ad68-691976723de9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:08.621677 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3455a113-a86c-4277-ad68-691976723de9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:08.627076 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3455a113-a86c-4277-ad68-691976723de9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:08.627521 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3455a113-a86c-4277-ad68-691976723de9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:08.628295 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3455a113-a86c-4277-ad68-691976723de9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:08.628729 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3455a113-a86c-4277-ad68-691976723de9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:08.749607 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e2cfc2d7-a92b-445f-ac7c-7a90e7867d97 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:08.750151 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e2cfc2d7-a92b-445f-ac7c-7a90e7867d97 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:08.756259 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e2cfc2d7-a92b-445f-ac7c-7a90e7867d97 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:08.757428 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e2cfc2d7-a92b-445f-ac7c-7a90e7867d97 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:08.758240 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e2cfc2d7-a92b-445f-ac7c-7a90e7867d97 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:08.758673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e2cfc2d7-a92b-445f-ac7c-7a90e7867d97 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:08.761543 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3455a113-a86c-4277-ad68-691976723de9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:08.769050 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3455a113-a86c-4277-ad68-691976723de9 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1678 microversion: 2.1 time: 0.152510 Jan 28 20:35:08.769698 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 451/923] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:08 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:08.772016 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-e2cfc2d7-a92b-445f-ac7c-7a90e7867d97 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] HTTP exception thrown: Instance dd446032-56d9-4e84-abd4-85bc3acbc24b could not be found. Jan 28 20:35:08.772779 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e2cfc2d7-a92b-445f-ac7c-7a90e7867d97 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Returning 404 to user: Instance dd446032-56d9-4e84-abd4-85bc3acbc24b could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:35:08.773594 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e2cfc2d7-a92b-445f-ac7c-7a90e7867d97 tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 404 len: 111 microversion: 2.20 time: 0.027815 Jan 28 20:35:08.774157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 473/924] 10.222.0.59 () {60 vars in 1279 bytes} [Fri Jan 28 20:35:08 2022] DELETE /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 20:35:08.781487 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3b5b3117-5ecd-4acc-9e71-a4dc662aaffc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:08.782176 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3b5b3117-5ecd-4acc-9e71-a4dc662aaffc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] [instance: dd446032-56d9-4e84-abd4-85bc3acbc24b] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:08.787842 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b5b3117-5ecd-4acc-9e71-a4dc662aaffc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:08.788317 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b5b3117-5ecd-4acc-9e71-a4dc662aaffc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:08.789199 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b5b3117-5ecd-4acc-9e71-a4dc662aaffc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:08.789676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3b5b3117-5ecd-4acc-9e71-a4dc662aaffc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:08.802276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-3b5b3117-5ecd-4acc-9e71-a4dc662aaffc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] HTTP exception thrown: Instance dd446032-56d9-4e84-abd4-85bc3acbc24b could not be found. Jan 28 20:35:08.802868 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3b5b3117-5ecd-4acc-9e71-a4dc662aaffc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] Returning 404 to user: Instance dd446032-56d9-4e84-abd4-85bc3acbc24b could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:35:08.804234 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3b5b3117-5ecd-4acc-9e71-a4dc662aaffc tempest-AttachVolumeShelveTestJSON-1576245594 tempest-AttachVolumeShelveTestJSON-1576245594-project] 10.222.0.59 "GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b" status: 404 len: 111 microversion: 2.20 time: 0.025643 Jan 28 20:35:08.804802 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 452/925] 10.222.0.59 () {60 vars in 1276 bytes} [Fri Jan 28 20:35:08 2022] GET /compute/v2.1/servers/dd446032-56d9-4e84-abd4-85bc3acbc24b => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 20:35:09.786997 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e771d4a6-e7f9-4f20-8a61-28bd266e3e6d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:09.787610 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e771d4a6-e7f9-4f20-8a61-28bd266e3e6d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:09.794059 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e771d4a6-e7f9-4f20-8a61-28bd266e3e6d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:09.794509 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e771d4a6-e7f9-4f20-8a61-28bd266e3e6d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:09.795383 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e771d4a6-e7f9-4f20-8a61-28bd266e3e6d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:09.795851 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e771d4a6-e7f9-4f20-8a61-28bd266e3e6d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:09.999672 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e771d4a6-e7f9-4f20-8a61-28bd266e3e6d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:10.007265 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e771d4a6-e7f9-4f20-8a61-28bd266e3e6d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1678 microversion: 2.1 time: 0.223977 Jan 28 20:35:10.007832 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 474/926] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:09 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:35:11.025053 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-aa5533a3-3a2e-4187-afd4-874bf5ccba8e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:11.026263 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-aa5533a3-3a2e-4187-afd4-874bf5ccba8e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:11.032963 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5533a3-3a2e-4187-afd4-874bf5ccba8e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:11.033494 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5533a3-3a2e-4187-afd4-874bf5ccba8e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:11.034549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5533a3-3a2e-4187-afd4-874bf5ccba8e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:11.035052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aa5533a3-3a2e-4187-afd4-874bf5ccba8e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:11.304709 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-aa5533a3-3a2e-4187-afd4-874bf5ccba8e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:11.312028 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-aa5533a3-3a2e-4187-afd4-874bf5ccba8e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1678 microversion: 2.1 time: 0.291578 Jan 28 20:35:11.312594 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 453/927] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:11 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1678 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:12.329776 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-5d51daf8-1589-4fad-ad17-f53d27bb3266 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:12.330430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-5d51daf8-1589-4fad-ad17-f53d27bb3266 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:12.337019 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5d51daf8-1589-4fad-ad17-f53d27bb3266 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:12.337490 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5d51daf8-1589-4fad-ad17-f53d27bb3266 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:12.338309 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5d51daf8-1589-4fad-ad17-f53d27bb3266 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:12.338927 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5d51daf8-1589-4fad-ad17-f53d27bb3266 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:12.483576 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-5d51daf8-1589-4fad-ad17-f53d27bb3266 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:12.492989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-5d51daf8-1589-4fad-ad17-f53d27bb3266 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1678 microversion: 2.1 time: 0.167172 Jan 28 20:35:12.494336 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 475/928] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:12 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:35:13.509780 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-851eca14-0494-4e7f-8b6d-efceed998312 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:13.510414 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-851eca14-0494-4e7f-8b6d-efceed998312 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:13.516627 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-851eca14-0494-4e7f-8b6d-efceed998312 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:13.517068 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-851eca14-0494-4e7f-8b6d-efceed998312 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:13.517841 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-851eca14-0494-4e7f-8b6d-efceed998312 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:13.518295 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-851eca14-0494-4e7f-8b6d-efceed998312 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:13.652243 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-851eca14-0494-4e7f-8b6d-efceed998312 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:13.659491 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-851eca14-0494-4e7f-8b6d-efceed998312 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1678 microversion: 2.1 time: 0.153347 Jan 28 20:35:13.660055 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 454/929] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:13 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:14.676213 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0d053a3c-ac2e-44b3-a5ad-5ee2a37e1084 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:14.676815 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0d053a3c-ac2e-44b3-a5ad-5ee2a37e1084 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:14.684216 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0d053a3c-ac2e-44b3-a5ad-5ee2a37e1084 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:14.684657 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0d053a3c-ac2e-44b3-a5ad-5ee2a37e1084 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:14.685494 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0d053a3c-ac2e-44b3-a5ad-5ee2a37e1084 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:14.685948 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0d053a3c-ac2e-44b3-a5ad-5ee2a37e1084 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:14.817034 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0d053a3c-ac2e-44b3-a5ad-5ee2a37e1084 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:14.824325 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0d053a3c-ac2e-44b3-a5ad-5ee2a37e1084 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1655 microversion: 2.1 time: 0.151797 Jan 28 20:35:14.824863 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 476/930] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:14 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:14.840719 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-72c08436-1d27-4433-a73a-3796068a204e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:35:14.847004 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72c08436-1d27-4433-a73a-3796068a204e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:14.847449 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-72c08436-1d27-4433-a73a-3796068a204e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:14.868881 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-72c08436-1d27-4433-a73a-3796068a204e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Going to try to start instance {{(pid=116275) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 20:35:14.907621 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-72c08436-1d27-4433-a73a-3796068a204e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/action" status: 202 len: 0 microversion: 2.1 time: 0.070539 Jan 28 20:35:14.908300 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 455/931] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:35:14 2022] POST /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:35:14.916630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e1e36d35-ddc6-4bad-ae11-8d1392b57e3f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:14.917240 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e1e36d35-ddc6-4bad-ae11-8d1392b57e3f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:14.922956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1e36d35-ddc6-4bad-ae11-8d1392b57e3f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:14.923384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1e36d35-ddc6-4bad-ae11-8d1392b57e3f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:14.924164 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1e36d35-ddc6-4bad-ae11-8d1392b57e3f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:14.924670 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e1e36d35-ddc6-4bad-ae11-8d1392b57e3f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:15.060231 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-e1e36d35-ddc6-4bad-ae11-8d1392b57e3f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:15.068111 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e1e36d35-ddc6-4bad-ae11-8d1392b57e3f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1664 microversion: 2.1 time: 0.155593 Jan 28 20:35:15.068920 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 477/932] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:14 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:35:16.087309 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cfdadab0-53a3-4085-9e21-6e20c798b468 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:35:16.088109 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cfdadab0-53a3-4085-9e21-6e20c798b468 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:35:16.094874 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfdadab0-53a3-4085-9e21-6e20c798b468 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:16.095323 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfdadab0-53a3-4085-9e21-6e20c798b468 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:16.096101 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfdadab0-53a3-4085-9e21-6e20c798b468 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:35:16.096534 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfdadab0-53a3-4085-9e21-6e20c798b468 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:35:16.227906 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-cfdadab0-53a3-4085-9e21-6e20c798b468 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:35:16.235550 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cfdadab0-53a3-4085-9e21-6e20c798b468 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1668 microversion: 2.1 time: 0.153055 Jan 28 20:35:16.236377 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 456/933] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:35:16 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:06.718675 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f30314d8-be07-4c14-92bf-3b581ae2cdf5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1339825803"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:06.719222 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f30314d8-be07-4c14-92bf-3b581ae2cdf5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:06.725250 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f30314d8-be07-4c14-92bf-3b581ae2cdf5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:06.726414 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f30314d8-be07-4c14-92bf-3b581ae2cdf5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:06.727216 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f30314d8-be07-4c14-92bf-3b581ae2cdf5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:06.727651 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f30314d8-be07-4c14-92bf-3b581ae2cdf5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:06.860673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.network.security_group_api [None req-f30314d8-be07-4c14-92bf-3b581ae2cdf5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Removing security group afcf3622-c704-4afc-a941-d7855444063a from port 93c9ee57-f372-42ef-bca7-ac691fd1d6e3 Jan 28 20:36:07.415407 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f30314d8-be07-4c14-92bf-3b581ae2cdf5 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "POST /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/action" status: 202 len: 0 microversion: 2.1 time: 0.700206 Jan 28 20:36:07.425421 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 478/934] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:36:06 2022] POST /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:36:07.431692 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-a563a598-5646-4b06-87c3-1aef6ef7468f req-db8e303e-a0f4-4c5e-91cd-cbe0ba593baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16081702-e065-419c-bb8c-8bb4ee6a7470", "tag": "93c9ee57-f372-42ef-bca7-ac691fd1d6e3"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:07.437361 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:07.437361 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:36:07.466859 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-a563a598-5646-4b06-87c3-1aef6ef7468f req-db8e303e-a0f4-4c5e-91cd-cbe0ba593baf service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:07.467552 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-a563a598-5646-4b06-87c3-1aef6ef7468f req-db8e303e-a0f4-4c5e-91cd-cbe0ba593baf service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:07.481407 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-a563a598-5646-4b06-87c3-1aef6ef7468f req-db8e303e-a0f4-4c5e-91cd-cbe0ba593baf service nova] Creating event network-changed:93c9ee57-f372-42ef-bca7-ac691fd1d6e3 for instance 16081702-e065-419c-bb8c-8bb4ee6a7470 on hv-cinder-82635 Jan 28 20:36:07.490628 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-a563a598-5646-4b06-87c3-1aef6ef7468f req-db8e303e-a0f4-4c5e-91cd-cbe0ba593baf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062923 Jan 28 20:36:07.492326 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 457/935] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:08.646277 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d88c19f2-4bc5-43e8-ba06-4f00e824d10e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:08.646997 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d88c19f2-4bc5-43e8-ba06-4f00e824d10e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:08.654486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d88c19f2-4bc5-43e8-ba06-4f00e824d10e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:08.654931 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d88c19f2-4bc5-43e8-ba06-4f00e824d10e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:08.655703 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d88c19f2-4bc5-43e8-ba06-4f00e824d10e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:08.656129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d88c19f2-4bc5-43e8-ba06-4f00e824d10e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:08.733630 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.objects.instance [None req-d88c19f2-4bc5-43e8-ba06-4f00e824d10e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lazy-loading 'services' on Instance uuid 16081702-e065-419c-bb8c-8bb4ee6a7470 {{(pid=116276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:36:08.805236 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d88c19f2-4bc5-43e8-ba06-4f00e824d10e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "DELETE /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments/803429d1-2f45-40f1-87c6-91a918868589" status: 202 len: 0 microversion: 2.1 time: 0.163502 Jan 28 20:36:08.806129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 479/936] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:36:08 2022] DELETE /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments/803429d1-2f45-40f1-87c6-91a918868589 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:36:08.815886 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-29957255-9a46-4643-96b4-93cabb6ade19 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:08.817553 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-29957255-9a46-4643-96b4-93cabb6ade19 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:08.825663 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-29957255-9a46-4643-96b4-93cabb6ade19 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:08.826154 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-29957255-9a46-4643-96b4-93cabb6ade19 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:08.826980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-29957255-9a46-4643-96b4-93cabb6ade19 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:08.827418 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-29957255-9a46-4643-96b4-93cabb6ade19 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:08.860675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-29957255-9a46-4643-96b4-93cabb6ade19 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050262 Jan 28 20:36:08.861238 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 458/937] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:36:08 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:09.507698 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-465b0099-f3c0-4882-a42b-a8bb0da2bd57 req-dc3c1984-96fe-4ad4-9524-ea2177076eda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16081702-e065-419c-bb8c-8bb4ee6a7470", "tag": "93c9ee57-f372-42ef-bca7-ac691fd1d6e3"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:09.509249 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:09.509249 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:36:09.516472 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-465b0099-f3c0-4882-a42b-a8bb0da2bd57 req-dc3c1984-96fe-4ad4-9524-ea2177076eda service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:09.516939 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-465b0099-f3c0-4882-a42b-a8bb0da2bd57 req-dc3c1984-96fe-4ad4-9524-ea2177076eda service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:09.529318 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-465b0099-f3c0-4882-a42b-a8bb0da2bd57 req-dc3c1984-96fe-4ad4-9524-ea2177076eda service nova] Creating event network-changed:93c9ee57-f372-42ef-bca7-ac691fd1d6e3 for instance 16081702-e065-419c-bb8c-8bb4ee6a7470 on hv-cinder-82635 Jan 28 20:36:09.534398 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-465b0099-f3c0-4882-a42b-a8bb0da2bd57 req-dc3c1984-96fe-4ad4-9524-ea2177076eda service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031076 Jan 28 20:36:09.534999 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 480/938] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:09.872693 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e4dad2bf-2cf6-4b07-a3f5-a220fdcb4bba tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:09.873712 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e4dad2bf-2cf6-4b07-a3f5-a220fdcb4bba tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:09.880056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e4dad2bf-2cf6-4b07-a3f5-a220fdcb4bba tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:09.880505 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e4dad2bf-2cf6-4b07-a3f5-a220fdcb4bba tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:09.881288 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e4dad2bf-2cf6-4b07-a3f5-a220fdcb4bba tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:09.881721 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e4dad2bf-2cf6-4b07-a3f5-a220fdcb4bba tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:09.910321 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e4dad2bf-2cf6-4b07-a3f5-a220fdcb4bba tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041358 Jan 28 20:36:09.916189 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 459/939] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:36:09 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 20:36:09.921689 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4d24ee96-7ee1-43c6-89f4-08248ddb5726 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:09.922284 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4d24ee96-7ee1-43c6-89f4-08248ddb5726 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:09.928435 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4d24ee96-7ee1-43c6-89f4-08248ddb5726 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:09.929721 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4d24ee96-7ee1-43c6-89f4-08248ddb5726 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:09.930674 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4d24ee96-7ee1-43c6-89f4-08248ddb5726 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:09.931081 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4d24ee96-7ee1-43c6-89f4-08248ddb5726 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:10.235556 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-4d24ee96-7ee1-43c6-89f4-08248ddb5726 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] HTTP exception thrown: Instance 16081702-e065-419c-bb8c-8bb4ee6a7470 is not attached to volume 803429d1-2f45-40f1-87c6-91a918868589 Jan 28 20:36:10.236156 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4d24ee96-7ee1-43c6-89f4-08248ddb5726 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Returning 404 to user: Instance 16081702-e065-419c-bb8c-8bb4ee6a7470 is not attached to volume 803429d1-2f45-40f1-87c6-91a918868589 {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:36:10.237108 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4d24ee96-7ee1-43c6-89f4-08248ddb5726 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "DELETE /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments/803429d1-2f45-40f1-87c6-91a918868589" status: 404 len: 154 microversion: 2.1 time: 0.319560 Jan 28 20:36:10.238107 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 481/940] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:36:09 2022] DELETE /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470/os-volume_attachments/803429d1-2f45-40f1-87c6-91a918868589 => generated 154 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:36:11.366911 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cb20f884-9230-4641-bc5e-c2503aabf719 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:11.367625 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cb20f884-9230-4641-bc5e-c2503aabf719 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:11.373833 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb20f884-9230-4641-bc5e-c2503aabf719 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:11.374301 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb20f884-9230-4641-bc5e-c2503aabf719 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:11.375080 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb20f884-9230-4641-bc5e-c2503aabf719 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:11.375510 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cb20f884-9230-4641-bc5e-c2503aabf719 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:11.401403 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cb20f884-9230-4641-bc5e-c2503aabf719 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:36:11.486684 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cb20f884-9230-4641-bc5e-c2503aabf719 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "DELETE /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 204 len: 0 microversion: 2.1 time: 0.123096 Jan 28 20:36:11.487520 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 460/941] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:36:11 2022] DELETE /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 20:36:11.498226 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7265770f-64c6-4bea-8978-53d1501f9f62 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:11.498914 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7265770f-64c6-4bea-8978-53d1501f9f62 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:11.505064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7265770f-64c6-4bea-8978-53d1501f9f62 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:11.505488 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7265770f-64c6-4bea-8978-53d1501f9f62 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:11.506304 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7265770f-64c6-4bea-8978-53d1501f9f62 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:11.507242 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7265770f-64c6-4bea-8978-53d1501f9f62 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:11.644989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7265770f-64c6-4bea-8978-53d1501f9f62 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:11.653716 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7265770f-64c6-4bea-8978-53d1501f9f62 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1555 microversion: 2.1 time: 0.161591 Jan 28 20:36:11.654422 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 482/942] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:11 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:12.504318 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:36:12.504980 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: Fri Jan 28 20:36:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:36:12.670846 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a6ccea66-4d60-45e5-b3c6-9146d6061764 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:12.671537 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a6ccea66-4d60-45e5-b3c6-9146d6061764 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:12.677731 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a6ccea66-4d60-45e5-b3c6-9146d6061764 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:12.678182 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a6ccea66-4d60-45e5-b3c6-9146d6061764 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:12.678955 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a6ccea66-4d60-45e5-b3c6-9146d6061764 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:12.679381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a6ccea66-4d60-45e5-b3c6-9146d6061764 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:12.866475 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-578329931", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "networks": [{"uuid": "9456407c-e824-4a10-bb14-b293a59163e9"}]}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:12.921261 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] validate_networks() for [('9456407c-e824-4a10-bb14-b293a59163e9', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:36:12.928701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a6ccea66-4d60-45e5-b3c6-9146d6061764 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:12.936392 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a6ccea66-4d60-45e5-b3c6-9146d6061764 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1555 microversion: 2.1 time: 0.269681 Jan 28 20:36:12.937057 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 461/943] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:12 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:13.262370 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:36:13.262792 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:36:13.263283 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:36:13.263685 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:36:13.264086 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:36:13.270457 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:36:13.270645 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: Fri Jan 28 20:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:36:13.272999 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:13.273442 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:13.274298 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:13.274730 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:13.291469 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Getting quotas for project f756fa797e7348fab2201dff5eb91ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:36:13.295197 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Getting quotas for user c78d2ca1ae8a4ecd8dc4545da9b51086 and project f756fa797e7348fab2201dff5eb91ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:36:13.306028 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:36:13.308342 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:36:13.352495 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-865c7e3d-f1cd-418e-bcd4-a81adb05bd32 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490351 Jan 28 20:36:13.353137 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 483/944] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 20:36:13.362771 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-21413432-7bf2-4897-80d9-fc6ada6287cd tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:13.363374 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-21413432-7bf2-4897-80d9-fc6ada6287cd tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:13.415119 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-21413432-7bf2-4897-80d9-fc6ada6287cd tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:13.421629 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-21413432-7bf2-4897-80d9-fc6ada6287cd tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1213 microversion: 2.1 time: 0.062530 Jan 28 20:36:13.422216 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 462/945] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:13 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:13.954509 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9354b1dd-1701-40a8-98ee-381625f25b4e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:13.955122 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9354b1dd-1701-40a8-98ee-381625f25b4e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:13.962573 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9354b1dd-1701-40a8-98ee-381625f25b4e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:13.963025 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9354b1dd-1701-40a8-98ee-381625f25b4e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:13.963818 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9354b1dd-1701-40a8-98ee-381625f25b4e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:13.964246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9354b1dd-1701-40a8-98ee-381625f25b4e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:14.106618 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9354b1dd-1701-40a8-98ee-381625f25b4e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834cf2d5ad64dec8602c45323f20d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3f2930540d4043b25e26a37f8a0a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:14.114213 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9354b1dd-1701-40a8-98ee-381625f25b4e tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 200 len: 1555 microversion: 2.1 time: 0.163875 Jan 28 20:36:14.114774 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 484/946] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:13 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:14.247923 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-5143a8bc-01a4-4271-968e-d1cda100d5f9 req-83109a90-0574-433e-91f5-2fd0621cff7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16081702-e065-419c-bb8c-8bb4ee6a7470", "name": "network-vif-deleted", "tag": "93c9ee57-f372-42ef-bca7-ac691fd1d6e3"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:14.250394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:14.250394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:36:14.261347 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-5143a8bc-01a4-4271-968e-d1cda100d5f9 req-83109a90-0574-433e-91f5-2fd0621cff7a service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:14.262125 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-5143a8bc-01a4-4271-968e-d1cda100d5f9 req-83109a90-0574-433e-91f5-2fd0621cff7a service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:14.274484 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-5143a8bc-01a4-4271-968e-d1cda100d5f9 req-83109a90-0574-433e-91f5-2fd0621cff7a service nova] Creating event network-vif-deleted:93c9ee57-f372-42ef-bca7-ac691fd1d6e3 for instance 16081702-e065-419c-bb8c-8bb4ee6a7470 on hv-cinder-82635 Jan 28 20:36:14.280068 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-5143a8bc-01a4-4271-968e-d1cda100d5f9 req-83109a90-0574-433e-91f5-2fd0621cff7a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035906 Jan 28 20:36:14.281262 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 463/947] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:14.439195 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ed34b6f4-ca51-41ab-8802-33f789da177f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:14.439850 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ed34b6f4-ca51-41ab-8802-33f789da177f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:14.447652 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed34b6f4-ca51-41ab-8802-33f789da177f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:14.448182 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed34b6f4-ca51-41ab-8802-33f789da177f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:14.450048 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed34b6f4-ca51-41ab-8802-33f789da177f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:14.451110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed34b6f4-ca51-41ab-8802-33f789da177f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:14.512434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ed34b6f4-ca51-41ab-8802-33f789da177f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:14.520690 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ed34b6f4-ca51-41ab-8802-33f789da177f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1271 microversion: 2.1 time: 0.085115 Jan 28 20:36:14.521576 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 485/948] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:14 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:15.131110 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a8de6919-7075-40be-9809-6489d547c607 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:15.131846 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a8de6919-7075-40be-9809-6489d547c607 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] [instance: 16081702-e065-419c-bb8c-8bb4ee6a7470] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:15.137955 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a8de6919-7075-40be-9809-6489d547c607 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:15.138355 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a8de6919-7075-40be-9809-6489d547c607 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:15.139128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a8de6919-7075-40be-9809-6489d547c607 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:15.139561 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a8de6919-7075-40be-9809-6489d547c607 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:15.152879 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-a8de6919-7075-40be-9809-6489d547c607 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] HTTP exception thrown: Instance 16081702-e065-419c-bb8c-8bb4ee6a7470 could not be found. Jan 28 20:36:15.153489 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a8de6919-7075-40be-9809-6489d547c607 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Returning 404 to user: Instance 16081702-e065-419c-bb8c-8bb4ee6a7470 could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:36:15.154326 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a8de6919-7075-40be-9809-6489d547c607 tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470" status: 404 len: 111 microversion: 2.1 time: 0.027234 Jan 28 20:36:15.154865 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 464/949] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:15 2022] GET /compute/v2.1/servers/16081702-e065-419c-bb8c-8bb4ee6a7470 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:36:15.162695 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-69df2780-c035-4b22-bbed-4e3e822c3e9a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] Calling method '.version_select at 0x7fc779db4d30>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:15.183365 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-69df2780-c035-4b22-bbed-4e3e822c3e9a tempest-TestMinimumBasicScenario-1822114439 tempest-TestMinimumBasicScenario-1822114439-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1502555881" status: 202 len: 0 microversion: 2.1 time: 0.024204 Jan 28 20:36:15.184255 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 486/950] 10.222.0.59 () {58 vars in 1271 bytes} [Fri Jan 28 20:36:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1502555881 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 20:36:15.536990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0d647b77-abcd-4923-980d-51385846b206 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:15.537596 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0d647b77-abcd-4923-980d-51385846b206 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:15.548569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0d647b77-abcd-4923-980d-51385846b206 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:15.549223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0d647b77-abcd-4923-980d-51385846b206 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:15.550044 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0d647b77-abcd-4923-980d-51385846b206 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:15.550475 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0d647b77-abcd-4923-980d-51385846b206 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:15.706529 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-0d647b77-abcd-4923-980d-51385846b206 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:15.714950 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0d647b77-abcd-4923-980d-51385846b206 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1313 microversion: 2.1 time: 0.181459 Jan 28 20:36:15.715533 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 465/951] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:15 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:16.309274 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-fd348327-4d59-4869-a54a-ea953d7076ed req-3974ac17-100b-46d2-838e-385241db2fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c52cfb0-f231-4ea1-8802-9b7d8f9ea334", "tag": "6b0f98c0-70ec-4450-95c3-1bf0df142497"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:16.310864 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:16.310864 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:36:16.318360 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-fd348327-4d59-4869-a54a-ea953d7076ed req-3974ac17-100b-46d2-838e-385241db2fad service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:16.318796 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-fd348327-4d59-4869-a54a-ea953d7076ed req-3974ac17-100b-46d2-838e-385241db2fad service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:16.329512 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-fd348327-4d59-4869-a54a-ea953d7076ed req-3974ac17-100b-46d2-838e-385241db2fad service nova] Creating event network-changed:6b0f98c0-70ec-4450-95c3-1bf0df142497 for instance 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 on hv-cinder-82635 Jan 28 20:36:16.334616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-fd348327-4d59-4869-a54a-ea953d7076ed req-3974ac17-100b-46d2-838e-385241db2fad service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029583 Jan 28 20:36:16.335224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 487/952] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:16.732020 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b18c9c59-0f67-4941-a1d2-df5a7a46b1b1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:16.732796 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b18c9c59-0f67-4941-a1d2-df5a7a46b1b1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:16.739241 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b18c9c59-0f67-4941-a1d2-df5a7a46b1b1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:16.739686 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b18c9c59-0f67-4941-a1d2-df5a7a46b1b1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:16.740485 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b18c9c59-0f67-4941-a1d2-df5a7a46b1b1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:16.741628 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b18c9c59-0f67-4941-a1d2-df5a7a46b1b1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:16.947305 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b18c9c59-0f67-4941-a1d2-df5a7a46b1b1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:16.954788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b18c9c59-0f67-4941-a1d2-df5a7a46b1b1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1313 microversion: 2.1 time: 0.226559 Jan 28 20:36:16.955408 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 466/953] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:16 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:17.973776 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-54881071-68b5-4640-ae32-f53586954689 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:17.975955 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-54881071-68b5-4640-ae32-f53586954689 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:17.982687 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-54881071-68b5-4640-ae32-f53586954689 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:17.990834 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-54881071-68b5-4640-ae32-f53586954689 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:17.992494 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-54881071-68b5-4640-ae32-f53586954689 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:17.993141 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-54881071-68b5-4640-ae32-f53586954689 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:18.321523 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-54881071-68b5-4640-ae32-f53586954689 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:18.331296 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-54881071-68b5-4640-ae32-f53586954689 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1313 microversion: 2.1 time: 0.362533 Jan 28 20:36:18.331973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 488/954] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:17 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:19.350821 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5fd12d03-e3d1-4109-9855-1f8fd5aaf141 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:19.351373 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5fd12d03-e3d1-4109-9855-1f8fd5aaf141 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:19.357038 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5fd12d03-e3d1-4109-9855-1f8fd5aaf141 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:19.357478 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5fd12d03-e3d1-4109-9855-1f8fd5aaf141 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:19.358284 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5fd12d03-e3d1-4109-9855-1f8fd5aaf141 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:19.358713 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5fd12d03-e3d1-4109-9855-1f8fd5aaf141 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:19.549371 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5fd12d03-e3d1-4109-9855-1f8fd5aaf141 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:19.558535 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5fd12d03-e3d1-4109-9855-1f8fd5aaf141 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1313 microversion: 2.1 time: 0.211565 Jan 28 20:36:19.560043 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 467/955] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:19 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:20.575431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-227a97ff-bf7d-4d3d-9a59-9ff20f17b762 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:20.576217 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-227a97ff-bf7d-4d3d-9a59-9ff20f17b762 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:20.582976 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-227a97ff-bf7d-4d3d-9a59-9ff20f17b762 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:20.583401 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-227a97ff-bf7d-4d3d-9a59-9ff20f17b762 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:20.584177 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-227a97ff-bf7d-4d3d-9a59-9ff20f17b762 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:20.584788 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-227a97ff-bf7d-4d3d-9a59-9ff20f17b762 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:20.885911 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-227a97ff-bf7d-4d3d-9a59-9ff20f17b762 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:20.893141 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-227a97ff-bf7d-4d3d-9a59-9ff20f17b762 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1313 microversion: 2.1 time: 0.321382 Jan 28 20:36:20.893744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 489/956] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:20 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:21.910196 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e63b77d8-192d-4037-a87c-5f347395aa25 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:21.910890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e63b77d8-192d-4037-a87c-5f347395aa25 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:21.917323 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e63b77d8-192d-4037-a87c-5f347395aa25 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:21.917778 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e63b77d8-192d-4037-a87c-5f347395aa25 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:21.918594 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e63b77d8-192d-4037-a87c-5f347395aa25 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:21.919030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e63b77d8-192d-4037-a87c-5f347395aa25 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:22.156233 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e63b77d8-192d-4037-a87c-5f347395aa25 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:22.168511 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e63b77d8-192d-4037-a87c-5f347395aa25 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1313 microversion: 2.1 time: 0.262096 Jan 28 20:36:22.169367 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 468/957] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:21 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:22.574586 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-8caf7119-b4f1-4e5b-9917-6db84f15807a req-be85ed33-fac2-4d55-8f3f-cb689078e0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c52cfb0-f231-4ea1-8802-9b7d8f9ea334", "name": "network-vif-plugged", "status": "completed", "tag": "6b0f98c0-70ec-4450-95c3-1bf0df142497"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:22.576098 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:22.576098 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:36:22.583655 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-8caf7119-b4f1-4e5b-9917-6db84f15807a req-be85ed33-fac2-4d55-8f3f-cb689078e0b5 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:22.584361 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-8caf7119-b4f1-4e5b-9917-6db84f15807a req-be85ed33-fac2-4d55-8f3f-cb689078e0b5 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:22.596217 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-8caf7119-b4f1-4e5b-9917-6db84f15807a req-be85ed33-fac2-4d55-8f3f-cb689078e0b5 service nova] Creating event network-vif-plugged:6b0f98c0-70ec-4450-95c3-1bf0df142497 for instance 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 on hv-cinder-82635 Jan 28 20:36:22.601999 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-8caf7119-b4f1-4e5b-9917-6db84f15807a req-be85ed33-fac2-4d55-8f3f-cb689078e0b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030883 Jan 28 20:36:22.603137 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 490/958] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:23.184184 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5f633a5b-8ace-4019-af8e-3bf91c76bca8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:23.184796 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5f633a5b-8ace-4019-af8e-3bf91c76bca8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:23.191456 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5f633a5b-8ace-4019-af8e-3bf91c76bca8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:23.191933 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5f633a5b-8ace-4019-af8e-3bf91c76bca8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:23.192722 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5f633a5b-8ace-4019-af8e-3bf91c76bca8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:23.193456 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5f633a5b-8ace-4019-af8e-3bf91c76bca8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:23.325284 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5f633a5b-8ace-4019-af8e-3bf91c76bca8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:23.332579 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5f633a5b-8ace-4019-af8e-3bf91c76bca8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1313 microversion: 2.1 time: 0.151977 Jan 28 20:36:23.333593 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 469/959] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:23 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:24.352181 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-796b968c-a72f-4aec-bcfe-b44dc028a0ef tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:24.352982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-796b968c-a72f-4aec-bcfe-b44dc028a0ef tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:24.359218 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-796b968c-a72f-4aec-bcfe-b44dc028a0ef tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:24.359669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-796b968c-a72f-4aec-bcfe-b44dc028a0ef tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:24.360459 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-796b968c-a72f-4aec-bcfe-b44dc028a0ef tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:24.360904 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-796b968c-a72f-4aec-bcfe-b44dc028a0ef tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:24.515455 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-796b968c-a72f-4aec-bcfe-b44dc028a0ef tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:24.524551 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-796b968c-a72f-4aec-bcfe-b44dc028a0ef tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1313 microversion: 2.1 time: 0.177504 Jan 28 20:36:24.525432 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 491/960] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:24 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:25.540957 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-26caf107-e6a2-492a-b5a8-362d3c04c076 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:25.542162 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-26caf107-e6a2-492a-b5a8-362d3c04c076 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:25.548711 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-26caf107-e6a2-492a-b5a8-362d3c04c076 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:25.549231 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-26caf107-e6a2-492a-b5a8-362d3c04c076 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:25.550078 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-26caf107-e6a2-492a-b5a8-362d3c04c076 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:25.550741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-26caf107-e6a2-492a-b5a8-362d3c04c076 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:25.714595 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-26caf107-e6a2-492a-b5a8-362d3c04c076 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:25.724495 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-26caf107-e6a2-492a-b5a8-362d3c04c076 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1313 microversion: 2.1 time: 0.187550 Jan 28 20:36:25.726105 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 470/961] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:25 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:36:26.747234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-cc063ff6-fda4-4306-abba-fce3bf0a7785 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:26.750782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-cc063ff6-fda4-4306-abba-fce3bf0a7785 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:26.764355 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cc063ff6-fda4-4306-abba-fce3bf0a7785 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:26.764953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cc063ff6-fda4-4306-abba-fce3bf0a7785 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:26.765866 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cc063ff6-fda4-4306-abba-fce3bf0a7785 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:26.766625 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-cc063ff6-fda4-4306-abba-fce3bf0a7785 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:26.973207 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-cc063ff6-fda4-4306-abba-fce3bf0a7785 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:26.982327 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-cc063ff6-fda4-4306-abba-fce3bf0a7785 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1498 microversion: 2.1 time: 0.243551 Jan 28 20:36:26.983011 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 492/962] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:26 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1498 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:27.800384 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-14850842-5b59-41eb-95ad-1d714e977f5f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:27.801617 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-14850842-5b59-41eb-95ad-1d714e977f5f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:27.810937 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-14850842-5b59-41eb-95ad-1d714e977f5f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:27.811964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-14850842-5b59-41eb-95ad-1d714e977f5f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:27.813052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-14850842-5b59-41eb-95ad-1d714e977f5f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:27.813689 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-14850842-5b59-41eb-95ad-1d714e977f5f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:28.020283 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-14850842-5b59-41eb-95ad-1d714e977f5f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:36:28.131420 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-14850842-5b59-41eb-95ad-1d714e977f5f tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 204 len: 0 microversion: 2.1 time: 0.338857 Jan 28 20:36:28.132996 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 471/963] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:36:27 2022] DELETE /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:36:28.141323 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-dd5c00fe-a1bb-4736-8d89-0aa7b2b0d304 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:28.142302 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-dd5c00fe-a1bb-4736-8d89-0aa7b2b0d304 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:28.152602 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dd5c00fe-a1bb-4736-8d89-0aa7b2b0d304 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:28.154224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dd5c00fe-a1bb-4736-8d89-0aa7b2b0d304 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:28.157298 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dd5c00fe-a1bb-4736-8d89-0aa7b2b0d304 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:28.158047 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dd5c00fe-a1bb-4736-8d89-0aa7b2b0d304 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:28.323803 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-dd5c00fe-a1bb-4736-8d89-0aa7b2b0d304 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:28.332080 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-dd5c00fe-a1bb-4736-8d89-0aa7b2b0d304 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1504 microversion: 2.1 time: 0.194418 Jan 28 20:36:28.332850 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 493/964] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:28 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:36:29.354112 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a84de1c8-8ccd-4326-9266-bc59047228d8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:29.354986 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a84de1c8-8ccd-4326-9266-bc59047228d8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:29.361204 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a84de1c8-8ccd-4326-9266-bc59047228d8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:29.361655 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a84de1c8-8ccd-4326-9266-bc59047228d8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:29.362470 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a84de1c8-8ccd-4326-9266-bc59047228d8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:29.362904 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a84de1c8-8ccd-4326-9266-bc59047228d8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:29.601327 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a84de1c8-8ccd-4326-9266-bc59047228d8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:29.609355 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a84de1c8-8ccd-4326-9266-bc59047228d8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1504 microversion: 2.1 time: 0.259159 Jan 28 20:36:29.609802 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 472/965] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:29 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:30.630830 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-97a90c0b-8944-4888-bec2-79f70c5c87c5 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:30.631501 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-97a90c0b-8944-4888-bec2-79f70c5c87c5 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:30.648876 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-cbc4e01a-4feb-49e4-826b-aead3ec9d8aa req-243d1538-99a2-42df-bcb6-7f6ed626bcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c52cfb0-f231-4ea1-8802-9b7d8f9ea334", "name": "network-vif-deleted", "tag": "6b0f98c0-70ec-4450-95c3-1bf0df142497"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:30.651523 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:30.651523 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:36:30.662152 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-97a90c0b-8944-4888-bec2-79f70c5c87c5 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:30.665981 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-97a90c0b-8944-4888-bec2-79f70c5c87c5 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:30.666862 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-97a90c0b-8944-4888-bec2-79f70c5c87c5 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:30.667305 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-97a90c0b-8944-4888-bec2-79f70c5c87c5 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:30.671759 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-cbc4e01a-4feb-49e4-826b-aead3ec9d8aa req-243d1538-99a2-42df-bcb6-7f6ed626bcd2 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:30.672204 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-cbc4e01a-4feb-49e4-826b-aead3ec9d8aa req-243d1538-99a2-42df-bcb6-7f6ed626bcd2 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:30.697445 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-cbc4e01a-4feb-49e4-826b-aead3ec9d8aa req-243d1538-99a2-42df-bcb6-7f6ed626bcd2 service nova] Creating event network-vif-deleted:6b0f98c0-70ec-4450-95c3-1bf0df142497 for instance 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 on hv-cinder-82635 Jan 28 20:36:30.702710 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-cbc4e01a-4feb-49e4-826b-aead3ec9d8aa req-243d1538-99a2-42df-bcb6-7f6ed626bcd2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059813 Jan 28 20:36:30.703946 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 473/966] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:30.773264 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-97a90c0b-8944-4888-bec2-79f70c5c87c5 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:30.782224 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-97a90c0b-8944-4888-bec2-79f70c5c87c5 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 200 len: 1298 microversion: 2.1 time: 0.157968 Jan 28 20:36:30.783117 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 494/967] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:30 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:30.888165 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-959449646", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1067414585", "security_groups": [{"name": "tempest-secgroup-smoke-35562867"}], "block_device_mapping_v2": [{"uuid": "d0d7dc53-27f3-46af-83d6-bf3fd5eeb247", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4706b4ac-208e-49dd-94bd-78970bce488d"}]}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:31.047975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.network.neutron [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] validate_networks() for [('4706b4ac-208e-49dd-94bd-78970bce488d', None, None, None, None, None)] {{(pid=116275) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:36:31.799056 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-427d8e64-2a9f-427a-8984-4a126beffa39 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:31.800642 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-427d8e64-2a9f-427a-8984-4a126beffa39 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:31.819129 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-427d8e64-2a9f-427a-8984-4a126beffa39 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:31.819773 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-427d8e64-2a9f-427a-8984-4a126beffa39 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:31.820729 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-427d8e64-2a9f-427a-8984-4a126beffa39 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:31.821456 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-427d8e64-2a9f-427a-8984-4a126beffa39 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:31.849374 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-427d8e64-2a9f-427a-8984-4a126beffa39 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] HTTP exception thrown: Instance 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 could not be found. Jan 28 20:36:31.850759 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-427d8e64-2a9f-427a-8984-4a126beffa39 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Returning 404 to user: Instance 4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:36:31.851944 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-427d8e64-2a9f-427a-8984-4a126beffa39 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334" status: 404 len: 111 microversion: 2.1 time: 0.056381 Jan 28 20:36:31.852996 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 495/968] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:31 2022] GET /compute/v2.1/servers/4c52cfb0-f231-4ea1-8802-9b7d8f9ea334 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:36:32.044063 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Flavor limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:36:32.045188 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Image limits 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:36:32.045737 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Flavor pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:36:32.046285 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Image pref 0:0:0 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:36:32.046921 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.virt.hardware [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:36:32.070637 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:32.071104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:32.072231 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:32.072897 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:32.100333 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-62681218", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "networks": [{"uuid": "9456407c-e824-4a10-bb14-b293a59163e9"}]}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:32.103575 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:36:32.116884 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Getting quotas for user daa1f16966e94f0fb861bf124bbc0aac and project aa2f11f2a3714a9c9a72ab77ea3d288b. Resources: {'ram', 'cores', 'instances'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:36:32.187506 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] validate_networks() for [('9456407c-e824-4a10-bb14-b293a59163e9', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:36:32.212579 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Going to run 1 instances... {{(pid=116275) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:36:32.216383 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d0d7dc53-27f3-46af-83d6-bf3fd5eeb247',volume_size=None,volume_type=None)] {{(pid=116275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:36:32.455424 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-40f79cef-2a48-417e-9711-aa85143a7c91 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.570274 Jan 28 20:36:32.463369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 474/969] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:36:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 20:36:32.478736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cb4ba242-75c6-4777-8175-8bf74132b51e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:32.479604 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cb4ba242-75c6-4777-8175-8bf74132b51e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:32.634349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-cb4ba242-75c6-4777-8175-8bf74132b51e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:32.648580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cb4ba242-75c6-4777-8175-8bf74132b51e tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1094 microversion: 2.1 time: 0.183950 Jan 28 20:36:32.649361 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 475/970] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:32 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1094 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:32.922019 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:36:32.922510 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:36:32.922899 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:36:32.923608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:36:32.924201 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:36:32.940069 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:32.940790 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:32.941755 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:32.946320 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:32.994544 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Getting quotas for project f756fa797e7348fab2201dff5eb91ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:36:32.999363 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Getting quotas for user c78d2ca1ae8a4ecd8dc4545da9b51086 and project f756fa797e7348fab2201dff5eb91ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:36:33.022292 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:36:33.024843 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:36:33.101835 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-66d53a61-4e36-4110-a008-506bd5eb5eed tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005617 Jan 28 20:36:33.102529 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 496/971] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:36:33.113247 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8d2b5258-1815-4418-a6ae-ad866cfb51b8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:33.114484 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8d2b5258-1815-4418-a6ae-ad866cfb51b8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:33.278337 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8d2b5258-1815-4418-a6ae-ad866cfb51b8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:33.286730 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8d2b5258-1815-4418-a6ae-ad866cfb51b8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1212 microversion: 2.1 time: 0.177838 Jan 28 20:36:33.287934 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 476/972] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:33 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1212 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:33.667905 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0ce26c5e-7e6c-4ad0-8231-925904ae6418 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:33.668611 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0ce26c5e-7e6c-4ad0-8231-925904ae6418 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:33.691368 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ce26c5e-7e6c-4ad0-8231-925904ae6418 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:33.692203 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ce26c5e-7e6c-4ad0-8231-925904ae6418 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:33.699234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ce26c5e-7e6c-4ad0-8231-925904ae6418 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:33.699908 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0ce26c5e-7e6c-4ad0-8231-925904ae6418 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:33.728418 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e6155db0-4173-47b7-92d6-aa59d27d1478 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:33.729630 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e6155db0-4173-47b7-92d6-aa59d27d1478 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:33.738186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e6155db0-4173-47b7-92d6-aa59d27d1478 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:33.746972 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e6155db0-4173-47b7-92d6-aa59d27d1478 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:33.748565 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e6155db0-4173-47b7-92d6-aa59d27d1478 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:33.749444 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e6155db0-4173-47b7-92d6-aa59d27d1478 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:33.834192 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e6155db0-4173-47b7-92d6-aa59d27d1478 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111715 Jan 28 20:36:33.840746 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 477/973] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:36:33 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 20:36:33.891781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0ce26c5e-7e6c-4ad0-8231-925904ae6418 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:33.902379 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0ce26c5e-7e6c-4ad0-8231-925904ae6418 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1192 microversion: 2.1 time: 0.239991 Jan 28 20:36:33.911760 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 497/974] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:33 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1192 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:33.977574 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b594c737-e001-40d6-98c8-e3e14b2a2345 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:33.978159 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b594c737-e001-40d6-98c8-e3e14b2a2345 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:33.989523 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b594c737-e001-40d6-98c8-e3e14b2a2345 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:33.990024 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b594c737-e001-40d6-98c8-e3e14b2a2345 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:33.990877 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b594c737-e001-40d6-98c8-e3e14b2a2345 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:33.991320 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b594c737-e001-40d6-98c8-e3e14b2a2345 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:34.039130 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b594c737-e001-40d6-98c8-e3e14b2a2345 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:36:34.230345 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b594c737-e001-40d6-98c8-e3e14b2a2345 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 204 len: 0 microversion: 2.1 time: 0.254685 Jan 28 20:36:34.233672 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 478/975] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:36:33 2022] DELETE /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:36:34.242054 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a343cb58-358e-487f-b4b5-49ddd06e3acb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:34.243489 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a343cb58-358e-487f-b4b5-49ddd06e3acb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:34.254182 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a343cb58-358e-487f-b4b5-49ddd06e3acb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:34.256956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a343cb58-358e-487f-b4b5-49ddd06e3acb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:34.259136 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a343cb58-358e-487f-b4b5-49ddd06e3acb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:34.259835 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a343cb58-358e-487f-b4b5-49ddd06e3acb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:34.305056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ac6c37fc-4870-4deb-8a41-f45eadc08683 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:34.306032 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ac6c37fc-4870-4deb-8a41-f45eadc08683 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:34.324813 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ac6c37fc-4870-4deb-8a41-f45eadc08683 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:34.327278 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ac6c37fc-4870-4deb-8a41-f45eadc08683 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:34.328871 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ac6c37fc-4870-4deb-8a41-f45eadc08683 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:34.334584 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ac6c37fc-4870-4deb-8a41-f45eadc08683 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:34.566560 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ac6c37fc-4870-4deb-8a41-f45eadc08683 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:34.576840 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ac6c37fc-4870-4deb-8a41-f45eadc08683 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1264 microversion: 2.1 time: 0.276126 Jan 28 20:36:34.580757 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 479/976] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:34 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1264 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:34.674464 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a343cb58-358e-487f-b4b5-49ddd06e3acb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:34.685609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a343cb58-358e-487f-b4b5-49ddd06e3acb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1674 microversion: 2.1 time: 0.446356 Jan 28 20:36:34.689114 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 498/977] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:34 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1674 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:34.933628 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b9757f58-7e48-4285-b621-cef0a1889873 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:34.934338 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b9757f58-7e48-4285-b621-cef0a1889873 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:34.941555 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b9757f58-7e48-4285-b621-cef0a1889873 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:34.942052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b9757f58-7e48-4285-b621-cef0a1889873 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:34.942902 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b9757f58-7e48-4285-b621-cef0a1889873 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:34.943369 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b9757f58-7e48-4285-b621-cef0a1889873 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:35.047251 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b9757f58-7e48-4285-b621-cef0a1889873 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:35.057680 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b9757f58-7e48-4285-b621-cef0a1889873 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1210 microversion: 2.1 time: 0.132372 Jan 28 20:36:35.059394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 480/978] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:34 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:35.596471 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-61e17708-4d91-4205-ab21-3dcc3ff3f2a4 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:35.597353 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-61e17708-4d91-4205-ab21-3dcc3ff3f2a4 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:35.604386 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61e17708-4d91-4205-ab21-3dcc3ff3f2a4 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:35.604831 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61e17708-4d91-4205-ab21-3dcc3ff3f2a4 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:35.605622 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61e17708-4d91-4205-ab21-3dcc3ff3f2a4 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:35.606092 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-61e17708-4d91-4205-ab21-3dcc3ff3f2a4 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:35.684992 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-61e17708-4d91-4205-ab21-3dcc3ff3f2a4 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:35.692676 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-61e17708-4d91-4205-ab21-3dcc3ff3f2a4 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1270 microversion: 2.1 time: 0.099856 Jan 28 20:36:35.694064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 499/979] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:35 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:35.704390 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8fa587ae-8832-4f41-8a8e-969ddde80f9c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:35.705081 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8fa587ae-8832-4f41-8a8e-969ddde80f9c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:35.711694 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8fa587ae-8832-4f41-8a8e-969ddde80f9c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:35.712757 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8fa587ae-8832-4f41-8a8e-969ddde80f9c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:35.713918 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8fa587ae-8832-4f41-8a8e-969ddde80f9c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:35.714541 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8fa587ae-8832-4f41-8a8e-969ddde80f9c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:35.864737 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8fa587ae-8832-4f41-8a8e-969ddde80f9c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:35.873456 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8fa587ae-8832-4f41-8a8e-969ddde80f9c tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1674 microversion: 2.1 time: 0.172722 Jan 28 20:36:35.874363 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 481/980] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:35 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:36.075168 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a5f3d57f-8e59-4494-ba05-d41a22941024 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:36.075795 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a5f3d57f-8e59-4494-ba05-d41a22941024 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:36.082320 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a5f3d57f-8e59-4494-ba05-d41a22941024 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:36.082769 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a5f3d57f-8e59-4494-ba05-d41a22941024 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:36.083734 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a5f3d57f-8e59-4494-ba05-d41a22941024 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:36.084328 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a5f3d57f-8e59-4494-ba05-d41a22941024 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:36.152769 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a5f3d57f-8e59-4494-ba05-d41a22941024 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:36.160724 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a5f3d57f-8e59-4494-ba05-d41a22941024 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1198 microversion: 2.1 time: 0.089129 Jan 28 20:36:36.161954 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 500/981] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:36 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:36.714200 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-885ef963-5837-46a5-83dc-0a2c424c8668 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:36.714814 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-885ef963-5837-46a5-83dc-0a2c424c8668 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:36.730342 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-885ef963-5837-46a5-83dc-0a2c424c8668 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:36.730804 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-885ef963-5837-46a5-83dc-0a2c424c8668 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:36.738524 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-885ef963-5837-46a5-83dc-0a2c424c8668 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:36.739105 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-885ef963-5837-46a5-83dc-0a2c424c8668 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:37.020487 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-885ef963-5837-46a5-83dc-0a2c424c8668 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:37.030539 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-885ef963-5837-46a5-83dc-0a2c424c8668 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1312 microversion: 2.1 time: 0.323766 Jan 28 20:36:37.033260 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 482/982] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:36 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1312 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:37.038615 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5c3b6c0f-59a5-4358-97a3-d239ef08c142 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:37.039940 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-5c3b6c0f-59a5-4358-97a3-d239ef08c142 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:37.047066 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c0f-59a5-4358-97a3-d239ef08c142 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:37.047836 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c0f-59a5-4358-97a3-d239ef08c142 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:37.049667 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c0f-59a5-4358-97a3-d239ef08c142 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:37.050243 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-5c3b6c0f-59a5-4358-97a3-d239ef08c142 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:37.102451 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-83859fb1-dd24-4b90-9a90-9a774ee6b3db tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Action: 'create', calling method: .version_select at 0x7fc779e02940>, body: {"keypair": {"name": "tempest-TestShelveInstance-224574802"}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:37.123215 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-83859fb1-dd24-4b90-9a90-9a774ee6b3db tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Getting quotas for project ae0bc0d163664eefa8c2c16ca7a80896. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:36:37.128447 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-83859fb1-dd24-4b90-9a90-9a774ee6b3db tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Getting quotas for user 8bfbac7ec87a40dab1aad77948afcfd5 and project ae0bc0d163664eefa8c2c16ca7a80896. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:36:37.253197 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-5c3b6c0f-59a5-4358-97a3-d239ef08c142 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:37.261668 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5c3b6c0f-59a5-4358-97a3-d239ef08c142 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1674 microversion: 2.1 time: 0.227135 Jan 28 20:36:37.262561 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 483/983] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:37 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:37.279893 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b4e6f5c2-27e2-455d-b7d4-1e02011d1c78 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:37.281107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b4e6f5c2-27e2-455d-b7d4-1e02011d1c78 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:37.289424 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4e6f5c2-27e2-455d-b7d4-1e02011d1c78 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:37.290171 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4e6f5c2-27e2-455d-b7d4-1e02011d1c78 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:37.291268 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4e6f5c2-27e2-455d-b7d4-1e02011d1c78 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:37.292127 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4e6f5c2-27e2-455d-b7d4-1e02011d1c78 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:37.332841 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-83859fb1-dd24-4b90-9a90-9a774ee6b3db tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Getting quotas for project ae0bc0d163664eefa8c2c16ca7a80896. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:36:37.337311 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-83859fb1-dd24-4b90-9a90-9a774ee6b3db tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Getting quotas for user 8bfbac7ec87a40dab1aad77948afcfd5 and project ae0bc0d163664eefa8c2c16ca7a80896. Resources: {'key_pairs'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:36:37.354597 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-83859fb1-dd24-4b90-9a90-9a774ee6b3db tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.620810 Jan 28 20:36:37.359785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 501/984] 10.222.0.59 () {60 vars in 1157 bytes} [Fri Jan 28 20:36:36 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:36:37.522404 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b4e6f5c2-27e2-455d-b7d4-1e02011d1c78 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:37.533703 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b4e6f5c2-27e2-455d-b7d4-1e02011d1c78 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.258500 Jan 28 20:36:37.534632 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 484/985] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:37 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:38.051050 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7c6d1f4c-b347-4c85-9517-8365b4ebf207 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:38.051904 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7c6d1f4c-b347-4c85-9517-8365b4ebf207 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:38.065228 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c6d1f4c-b347-4c85-9517-8365b4ebf207 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:38.067522 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c6d1f4c-b347-4c85-9517-8365b4ebf207 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:38.070801 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c6d1f4c-b347-4c85-9517-8365b4ebf207 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:38.071274 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c6d1f4c-b347-4c85-9517-8365b4ebf207 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:38.294901 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c2c214e2-1210-462b-81b6-8ec11afd839b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:38.295915 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c2c214e2-1210-462b-81b6-8ec11afd839b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:38.313507 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c2c214e2-1210-462b-81b6-8ec11afd839b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:38.320034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c2c214e2-1210-462b-81b6-8ec11afd839b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:38.321062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c2c214e2-1210-462b-81b6-8ec11afd839b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:38.323604 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c2c214e2-1210-462b-81b6-8ec11afd839b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:38.459315 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c2c214e2-1210-462b-81b6-8ec11afd839b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:38.479590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c2c214e2-1210-462b-81b6-8ec11afd839b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1607 microversion: 2.1 time: 0.202401 Jan 28 20:36:38.489741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 485/986] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:38 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1607 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:38.551831 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-73c40e01-1fd2-4de8-9a1c-34793b661888 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:38.553351 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-73c40e01-1fd2-4de8-9a1c-34793b661888 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:38.564955 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-73c40e01-1fd2-4de8-9a1c-34793b661888 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:38.565452 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-73c40e01-1fd2-4de8-9a1c-34793b661888 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:38.567234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7c6d1f4c-b347-4c85-9517-8365b4ebf207 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:38.568820 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-73c40e01-1fd2-4de8-9a1c-34793b661888 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:38.569221 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-73c40e01-1fd2-4de8-9a1c-34793b661888 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:38.580181 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7c6d1f4c-b347-4c85-9517-8365b4ebf207 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1312 microversion: 2.1 time: 0.534760 Jan 28 20:36:38.582596 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 502/987] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:38 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1312 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:38.897649 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-73c40e01-1fd2-4de8-9a1c-34793b661888 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:38.944824 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-73c40e01-1fd2-4de8-9a1c-34793b661888 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.393128 Jan 28 20:36:38.946925 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 486/988] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:38 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:39.112855 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-e3d0502c-1c44-400e-9691-3fb026b74efa req-3bd0eded-6802-49f2-bcd6-02443a5da529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9301756-2919-4996-8f98-7004d11de728", "tag": "38d64510-69e9-4d58-b32a-547abb46e890"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:39.116095 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:39.116095 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:36:39.131241 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-e3d0502c-1c44-400e-9691-3fb026b74efa req-3bd0eded-6802-49f2-bcd6-02443a5da529 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:39.132728 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-e3d0502c-1c44-400e-9691-3fb026b74efa req-3bd0eded-6802-49f2-bcd6-02443a5da529 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:39.151887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-e3d0502c-1c44-400e-9691-3fb026b74efa req-3bd0eded-6802-49f2-bcd6-02443a5da529 service nova] Creating event network-changed:38d64510-69e9-4d58-b32a-547abb46e890 for instance e9301756-2919-4996-8f98-7004d11de728 on hv-cinder-82635 Jan 28 20:36:39.163376 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-e3d0502c-1c44-400e-9691-3fb026b74efa req-3bd0eded-6802-49f2-bcd6-02443a5da529 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061953 Jan 28 20:36:39.164929 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 503/989] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:39.498905 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-98d860b8-b4c8-4a84-8a1b-27fb289ee786 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:39.499619 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-98d860b8-b4c8-4a84-8a1b-27fb289ee786 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:39.510678 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98d860b8-b4c8-4a84-8a1b-27fb289ee786 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:39.514125 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98d860b8-b4c8-4a84-8a1b-27fb289ee786 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:39.518532 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98d860b8-b4c8-4a84-8a1b-27fb289ee786 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:39.521818 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-98d860b8-b4c8-4a84-8a1b-27fb289ee786 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:39.600547 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-157f61b7-5242-4a1e-8fcd-3e139ec620b7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:39.601363 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-157f61b7-5242-4a1e-8fcd-3e139ec620b7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:39.622721 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-157f61b7-5242-4a1e-8fcd-3e139ec620b7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:39.623648 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-157f61b7-5242-4a1e-8fcd-3e139ec620b7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:39.625587 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-157f61b7-5242-4a1e-8fcd-3e139ec620b7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:39.626435 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-157f61b7-5242-4a1e-8fcd-3e139ec620b7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:39.699260 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-98d860b8-b4c8-4a84-8a1b-27fb289ee786 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:39.713136 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-98d860b8-b4c8-4a84-8a1b-27fb289ee786 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 200 len: 1323 microversion: 2.1 time: 0.220150 Jan 28 20:36:39.714920 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 487/990] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:39 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 1323 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:39.850768 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-157f61b7-5242-4a1e-8fcd-3e139ec620b7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:39.861911 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-157f61b7-5242-4a1e-8fcd-3e139ec620b7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1312 microversion: 2.1 time: 0.266598 Jan 28 20:36:39.862805 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 504/991] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:39 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:36:39.962385 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-342aa724-ff8a-43b4-a553-d04bfde00297 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:39.963147 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-342aa724-ff8a-43b4-a553-d04bfde00297 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:39.972947 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-342aa724-ff8a-43b4-a553-d04bfde00297 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:39.973504 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-342aa724-ff8a-43b4-a553-d04bfde00297 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:39.976624 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-342aa724-ff8a-43b4-a553-d04bfde00297 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:39.977186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-342aa724-ff8a-43b4-a553-d04bfde00297 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:40.180035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-342aa724-ff8a-43b4-a553-d04bfde00297 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:40.196981 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-342aa724-ff8a-43b4-a553-d04bfde00297 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.238134 Jan 28 20:36:40.207027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 488/992] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:39 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:40.730877 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f6726968-fa4a-41a7-829a-50b591d90aee tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:40.731543 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f6726968-fa4a-41a7-829a-50b591d90aee tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:40.737673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f6726968-fa4a-41a7-829a-50b591d90aee tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:40.738156 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f6726968-fa4a-41a7-829a-50b591d90aee tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:40.738949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f6726968-fa4a-41a7-829a-50b591d90aee tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:40.739412 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f6726968-fa4a-41a7-829a-50b591d90aee tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:40.753400 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-f6726968-fa4a-41a7-829a-50b591d90aee tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] HTTP exception thrown: Instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed could not be found. Jan 28 20:36:40.754580 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f6726968-fa4a-41a7-829a-50b591d90aee tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Returning 404 to user: Instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:36:40.756126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f6726968-fa4a-41a7-829a-50b591d90aee tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 404 len: 111 microversion: 2.1 time: 0.029249 Jan 28 20:36:40.757137 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 505/993] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:40 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:36:40.765685 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1e1f59b7-efa9-4a68-b15e-a358dc9cc1b1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '.version_select at 0x7fc779439280>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:40.788264 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1e1f59b7-efa9-4a68-b15e-a358dc9cc1b1 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310052902" status: 202 len: 0 microversion: 2.1 time: 0.025661 Jan 28 20:36:40.788869 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 489/994] 10.222.0.59 () {58 vars in 1220 bytes} [Fri Jan 28 20:36:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310052902 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:36:40.880232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c21ce350-028e-4674-b0ff-ef2230a15104 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:40.881519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c21ce350-028e-4674-b0ff-ef2230a15104 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:40.888623 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c21ce350-028e-4674-b0ff-ef2230a15104 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:40.889449 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c21ce350-028e-4674-b0ff-ef2230a15104 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:40.890678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c21ce350-028e-4674-b0ff-ef2230a15104 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:40.891338 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c21ce350-028e-4674-b0ff-ef2230a15104 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:41.116864 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c21ce350-028e-4674-b0ff-ef2230a15104 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:41.124350 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c21ce350-028e-4674-b0ff-ef2230a15104 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1312 microversion: 2.1 time: 0.247959 Jan 28 20:36:41.134408 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 506/995] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:40 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:41.190751 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-a65600af-5049-4572-b37e-815bca748430 req-f75fb850-665e-42b9-9bc2-29c151a25cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c701840-780a-4c1e-83e3-d03c2b53b0ed", "name": "network-vif-deleted", "tag": "4843d0bf-c438-4f38-b995-bd7e64982d92"}, {"name": "network-changed", "server_uuid": "388708b6-8f50-4a4a-8649-28b2ef0853cc", "tag": "da812586-076a-4920-8552-77b0cef95de7"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:41.193028 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:41.193028 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:36:41.206160 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-a65600af-5049-4572-b37e-815bca748430 req-f75fb850-665e-42b9-9bc2-29c151a25cbf service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:41.206829 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-a65600af-5049-4572-b37e-815bca748430 req-f75fb850-665e-42b9-9bc2-29c151a25cbf service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:41.212956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a283a98d-b02d-4ac7-ac8a-20c83b555ae1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:41.213668 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a283a98d-b02d-4ac7-ac8a-20c83b555ae1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:41.224663 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a283a98d-b02d-4ac7-ac8a-20c83b555ae1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:41.225460 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a283a98d-b02d-4ac7-ac8a-20c83b555ae1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:41.225688 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-a65600af-5049-4572-b37e-815bca748430 req-f75fb850-665e-42b9-9bc2-29c151a25cbf service nova] Creating event network-vif-deleted:4843d0bf-c438-4f38-b995-bd7e64982d92 for instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed on hv-cinder-82635 Jan 28 20:36:41.226380 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-a65600af-5049-4572-b37e-815bca748430 req-f75fb850-665e-42b9-9bc2-29c151a25cbf service nova] Creating event network-changed:da812586-076a-4920-8552-77b0cef95de7 for instance 388708b6-8f50-4a4a-8649-28b2ef0853cc on hv-cinder-82635 Jan 28 20:36:41.228385 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a283a98d-b02d-4ac7-ac8a-20c83b555ae1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:41.229036 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a283a98d-b02d-4ac7-ac8a-20c83b555ae1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:41.236887 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-a65600af-5049-4572-b37e-815bca748430 req-f75fb850-665e-42b9-9bc2-29c151a25cbf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049672 Jan 28 20:36:41.237802 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 490/996] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:41.383057 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a283a98d-b02d-4ac7-ac8a-20c83b555ae1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:41.390617 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a283a98d-b02d-4ac7-ac8a-20c83b555ae1 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.181346 Jan 28 20:36:41.391185 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 507/997] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:41 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:36:41.854020 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2467ce92-7391-464f-8253-fbef9e4e2170 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'create', calling method: .version_select at 0x7fc779439ee0>, body: {"keypair": {"name": "tempest-keypair-1302566773"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:41.868851 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-2467ce92-7391-464f-8253-fbef9e4e2170 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:36:41.872604 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-2467ce92-7391-464f-8253-fbef9e4e2170 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for user d078a621ec024fc287d6c8bb8c44679e and project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:36:42.012223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-2467ce92-7391-464f-8253-fbef9e4e2170 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:36:42.016035 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.quota [None req-2467ce92-7391-464f-8253-fbef9e4e2170 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for user d078a621ec024fc287d6c8bb8c44679e and project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'key_pairs'} {{(pid=116275) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:36:42.039588 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2467ce92-7391-464f-8253-fbef9e4e2170 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.191022 Jan 28 20:36:42.040555 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 491/998] 10.222.0.59 () {60 vars in 1157 bytes} [Fri Jan 28 20:36:41 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:42.147821 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-367d9698-c561-4b53-a059-c50f0d779238 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:42.148681 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-367d9698-c561-4b53-a059-c50f0d779238 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:42.157676 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-367d9698-c561-4b53-a059-c50f0d779238 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:42.158147 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-367d9698-c561-4b53-a059-c50f0d779238 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:42.159167 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-367d9698-c561-4b53-a059-c50f0d779238 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:42.159604 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-367d9698-c561-4b53-a059-c50f0d779238 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:42.307608 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-367d9698-c561-4b53-a059-c50f0d779238 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:42.317256 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-367d9698-c561-4b53-a059-c50f0d779238 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1312 microversion: 2.1 time: 0.177258 Jan 28 20:36:42.318205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 508/999] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:42 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:42.407959 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1f3d3990-8fa3-4ea9-be72-f6cb81571c30 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:42.408782 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1f3d3990-8fa3-4ea9-be72-f6cb81571c30 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:42.416489 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1f3d3990-8fa3-4ea9-be72-f6cb81571c30 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:42.416945 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1f3d3990-8fa3-4ea9-be72-f6cb81571c30 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:42.418069 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1f3d3990-8fa3-4ea9-be72-f6cb81571c30 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:42.418436 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1f3d3990-8fa3-4ea9-be72-f6cb81571c30 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:42.566193 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1f3d3990-8fa3-4ea9-be72-f6cb81571c30 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:42.574763 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1f3d3990-8fa3-4ea9-be72-f6cb81571c30 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.170614 Jan 28 20:36:42.575353 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 492/1000] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:42 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:43.308615 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-134992225", "imageRef": "4d3dc899-e175-4c1d-a1ed-072ea5b059c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb79ac15-c1bc-4519-8571-57377ab7b400"}], "security_groups": [{"name": "tempest-securitygroup--489226788"}], "key_name": "tempest-keypair-1302566773", "user_data": "}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:43.335112 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cfcf98cf-04d1-4732-bc67-f3d2f5b84966 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:43.335736 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cfcf98cf-04d1-4732-bc67-f3d2f5b84966 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:43.342491 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfcf98cf-04d1-4732-bc67-f3d2f5b84966 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:43.342941 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfcf98cf-04d1-4732-bc67-f3d2f5b84966 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:43.343724 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfcf98cf-04d1-4732-bc67-f3d2f5b84966 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:43.344162 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-cfcf98cf-04d1-4732-bc67-f3d2f5b84966 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:43.441157 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] validate_networks() for [('eb79ac15-c1bc-4519-8571-57377ab7b400', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:36:43.563910 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-cfcf98cf-04d1-4732-bc67-f3d2f5b84966 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:43.575079 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cfcf98cf-04d1-4732-bc67-f3d2f5b84966 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1312 microversion: 2.1 time: 0.244037 Jan 28 20:36:43.575926 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 493/1001] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:43 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:36:43.592573 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-39cfcccf-7134-4510-ac85-02aede83b434 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:43.593214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-39cfcccf-7134-4510-ac85-02aede83b434 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:43.600276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39cfcccf-7134-4510-ac85-02aede83b434 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:43.600838 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39cfcccf-7134-4510-ac85-02aede83b434 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:43.601733 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39cfcccf-7134-4510-ac85-02aede83b434 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:43.602294 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-39cfcccf-7134-4510-ac85-02aede83b434 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:43.838229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-39cfcccf-7134-4510-ac85-02aede83b434 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:43.846817 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-39cfcccf-7134-4510-ac85-02aede83b434 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.258651 Jan 28 20:36:43.847413 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 494/1002] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:43 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:36:43.950460 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:36:43.950887 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:36:43.951479 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:36:43.951895 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:36:43.952308 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:36:43.961743 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:43.962222 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:43.963045 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:43.963483 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:43.979810 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:36:43.983906 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Getting quotas for user d078a621ec024fc287d6c8bb8c44679e and project 1c0728fb029c4fd3acf933d889ce813d. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:36:43.994853 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:36:43.997182 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d3dc899-e175-4c1d-a1ed-072ea5b059c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:36:44.046070 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-e2e4d718-193d-47e3-a919-f5c8e5eac552 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.741558 Jan 28 20:36:44.046714 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 509/1003] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:36:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:36:44.058371 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cab12582-ea64-4788-9911-2bea16e6cee2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:44.059872 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-cab12582-ea64-4788-9911-2bea16e6cee2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:44.126469 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-cab12582-ea64-4788-9911-2bea16e6cee2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:44.139873 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cab12582-ea64-4788-9911-2bea16e6cee2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1237 microversion: 2.1 time: 0.085582 Jan 28 20:36:44.145232 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 495/1004] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:44 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:44.592305 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-178746fe-4a7a-4f96-ada6-d8af53380d6c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:44.593026 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-178746fe-4a7a-4f96-ada6-d8af53380d6c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:44.604075 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-178746fe-4a7a-4f96-ada6-d8af53380d6c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:44.604529 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-178746fe-4a7a-4f96-ada6-d8af53380d6c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:44.605330 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-178746fe-4a7a-4f96-ada6-d8af53380d6c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:44.605761 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-178746fe-4a7a-4f96-ada6-d8af53380d6c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:44.742629 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-178746fe-4a7a-4f96-ada6-d8af53380d6c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:44.750054 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-178746fe-4a7a-4f96-ada6-d8af53380d6c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1312 microversion: 2.1 time: 0.161700 Jan 28 20:36:44.751058 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 510/1005] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:44 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:44.863833 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-aec22d2d-687e-4e82-a238-6980399a136c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:44.864433 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-aec22d2d-687e-4e82-a238-6980399a136c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:44.871527 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aec22d2d-687e-4e82-a238-6980399a136c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:44.871795 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aec22d2d-687e-4e82-a238-6980399a136c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:44.872572 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aec22d2d-687e-4e82-a238-6980399a136c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:44.873000 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-aec22d2d-687e-4e82-a238-6980399a136c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:45.019019 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-aec22d2d-687e-4e82-a238-6980399a136c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:45.028519 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-aec22d2d-687e-4e82-a238-6980399a136c tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.168017 Jan 28 20:36:45.029117 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 496/1006] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:44 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:45.157364 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3dce7be0-a4dc-4c83-82a4-b6d24d41b2fb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:45.158001 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3dce7be0-a4dc-4c83-82a4-b6d24d41b2fb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:45.164179 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3dce7be0-a4dc-4c83-82a4-b6d24d41b2fb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:45.164647 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3dce7be0-a4dc-4c83-82a4-b6d24d41b2fb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:45.165753 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3dce7be0-a4dc-4c83-82a4-b6d24d41b2fb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:45.166216 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3dce7be0-a4dc-4c83-82a4-b6d24d41b2fb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:45.242120 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3dce7be0-a4dc-4c83-82a4-b6d24d41b2fb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:45.249695 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3dce7be0-a4dc-4c83-82a4-b6d24d41b2fb tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1295 microversion: 2.1 time: 0.096213 Jan 28 20:36:45.250373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 511/1007] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:45 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:45.667142 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-61071c2b-9919-4193-8560-b69dfa94bc99 req-c39b9d00-171d-48a4-b3c7-12ce46d3a403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "388708b6-8f50-4a4a-8649-28b2ef0853cc", "name": "network-vif-plugged", "status": "completed", "tag": "da812586-076a-4920-8552-77b0cef95de7"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:45.669286 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:45.669286 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:36:45.677942 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-61071c2b-9919-4193-8560-b69dfa94bc99 req-c39b9d00-171d-48a4-b3c7-12ce46d3a403 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:45.678629 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-61071c2b-9919-4193-8560-b69dfa94bc99 req-c39b9d00-171d-48a4-b3c7-12ce46d3a403 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:45.696973 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-61071c2b-9919-4193-8560-b69dfa94bc99 req-c39b9d00-171d-48a4-b3c7-12ce46d3a403 service nova] Creating event network-vif-plugged:da812586-076a-4920-8552-77b0cef95de7 for instance 388708b6-8f50-4a4a-8649-28b2ef0853cc on hv-cinder-82635 Jan 28 20:36:45.703630 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-61071c2b-9919-4193-8560-b69dfa94bc99 req-c39b9d00-171d-48a4-b3c7-12ce46d3a403 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040501 Jan 28 20:36:45.704452 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 497/1008] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:45.771785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-355d9b63-3b0f-4673-bdbc-2704d4747d14 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:45.773072 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-355d9b63-3b0f-4673-bdbc-2704d4747d14 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:45.783650 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-355d9b63-3b0f-4673-bdbc-2704d4747d14 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:45.784165 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-355d9b63-3b0f-4673-bdbc-2704d4747d14 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:45.785694 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-355d9b63-3b0f-4673-bdbc-2704d4747d14 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:45.786198 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-355d9b63-3b0f-4673-bdbc-2704d4747d14 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:45.954449 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-355d9b63-3b0f-4673-bdbc-2704d4747d14 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:45.962463 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-355d9b63-3b0f-4673-bdbc-2704d4747d14 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1312 microversion: 2.1 time: 0.196495 Jan 28 20:36:45.963034 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 512/1009] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:45 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:46.047446 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a0469f8f-2cde-4123-9905-038e23d49710 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:46.048052 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a0469f8f-2cde-4123-9905-038e23d49710 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:46.054752 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a0469f8f-2cde-4123-9905-038e23d49710 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:46.055281 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a0469f8f-2cde-4123-9905-038e23d49710 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:46.056222 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a0469f8f-2cde-4123-9905-038e23d49710 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:46.057034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a0469f8f-2cde-4123-9905-038e23d49710 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:46.203308 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a0469f8f-2cde-4123-9905-038e23d49710 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:46.211716 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a0469f8f-2cde-4123-9905-038e23d49710 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.168670 Jan 28 20:36:46.212303 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 498/1010] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:46 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:46.273126 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-a011d651-6c9a-43c9-80e0-e06576d95108 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:46.273747 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-a011d651-6c9a-43c9-80e0-e06576d95108 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:46.284409 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a011d651-6c9a-43c9-80e0-e06576d95108 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:46.284870 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a011d651-6c9a-43c9-80e0-e06576d95108 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:46.285736 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a011d651-6c9a-43c9-80e0-e06576d95108 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:46.286183 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-a011d651-6c9a-43c9-80e0-e06576d95108 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:46.449792 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-a011d651-6c9a-43c9-80e0-e06576d95108 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:46.462364 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-a011d651-6c9a-43c9-80e0-e06576d95108 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.197762 Jan 28 20:36:46.463175 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 513/1011] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:46 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:46.514709 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-c629f203-7b9d-461f-a21d-30960ea727b0 req-cc764faa-0c16-467b-b68d-0491ebd4037b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a281ecb1-a100-4005-a1e7-0a6598b9a1b9", "tag": "24f9fcbe-ec8a-4060-9907-5cd74d8b8ffd"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:46.516328 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:46.516328 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:36:46.525777 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-c629f203-7b9d-461f-a21d-30960ea727b0 req-cc764faa-0c16-467b-b68d-0491ebd4037b service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:46.526459 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-c629f203-7b9d-461f-a21d-30960ea727b0 req-cc764faa-0c16-467b-b68d-0491ebd4037b service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:46.544785 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-c629f203-7b9d-461f-a21d-30960ea727b0 req-cc764faa-0c16-467b-b68d-0491ebd4037b service nova] Creating event network-changed:24f9fcbe-ec8a-4060-9907-5cd74d8b8ffd for instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 on hv-cinder-82635 Jan 28 20:36:46.552224 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-c629f203-7b9d-461f-a21d-30960ea727b0 req-cc764faa-0c16-467b-b68d-0491ebd4037b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041127 Jan 28 20:36:46.552794 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 499/1012] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:46.978996 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b8104145-c2cc-4ab7-ab7d-b190657af3d1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:46.979735 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b8104145-c2cc-4ab7-ab7d-b190657af3d1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:46.986134 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b8104145-c2cc-4ab7-ab7d-b190657af3d1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:46.986773 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b8104145-c2cc-4ab7-ab7d-b190657af3d1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:46.987731 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b8104145-c2cc-4ab7-ab7d-b190657af3d1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:46.988407 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b8104145-c2cc-4ab7-ab7d-b190657af3d1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:47.135951 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b8104145-c2cc-4ab7-ab7d-b190657af3d1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:47.142657 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b8104145-c2cc-4ab7-ab7d-b190657af3d1 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1312 microversion: 2.1 time: 0.167225 Jan 28 20:36:47.143268 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 514/1013] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:46 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:47.228869 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4f432ce2-0742-420c-ba8c-7a16294053da tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:47.229558 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4f432ce2-0742-420c-ba8c-7a16294053da tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:47.237100 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f432ce2-0742-420c-ba8c-7a16294053da tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:47.237547 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f432ce2-0742-420c-ba8c-7a16294053da tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:47.238566 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f432ce2-0742-420c-ba8c-7a16294053da tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:47.239001 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4f432ce2-0742-420c-ba8c-7a16294053da tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:47.380915 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4f432ce2-0742-420c-ba8c-7a16294053da tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:47.388745 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4f432ce2-0742-420c-ba8c-7a16294053da tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.163875 Jan 28 20:36:47.389437 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 500/1014] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:47 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:47.479703 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7c4f6be4-460b-4ba2-910b-413ad09e7f27 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:47.480319 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7c4f6be4-460b-4ba2-910b-413ad09e7f27 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:47.486648 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c4f6be4-460b-4ba2-910b-413ad09e7f27 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:47.487523 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c4f6be4-460b-4ba2-910b-413ad09e7f27 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:47.488323 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c4f6be4-460b-4ba2-910b-413ad09e7f27 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:47.488772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7c4f6be4-460b-4ba2-910b-413ad09e7f27 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:47.629457 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7c4f6be4-460b-4ba2-910b-413ad09e7f27 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:47.636833 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7c4f6be4-460b-4ba2-910b-413ad09e7f27 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.161311 Jan 28 20:36:47.637392 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 515/1015] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:47 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:48.159333 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3d0cafda-d4b4-44d8-a49b-9baf93bfb9c9 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:48.159937 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3d0cafda-d4b4-44d8-a49b-9baf93bfb9c9 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:48.165892 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3d0cafda-d4b4-44d8-a49b-9baf93bfb9c9 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.166349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3d0cafda-d4b4-44d8-a49b-9baf93bfb9c9 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:48.167116 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3d0cafda-d4b4-44d8-a49b-9baf93bfb9c9 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.167548 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3d0cafda-d4b4-44d8-a49b-9baf93bfb9c9 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:48.301172 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3d0cafda-d4b4-44d8-a49b-9baf93bfb9c9 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:48.309047 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3d0cafda-d4b4-44d8-a49b-9baf93bfb9c9 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1496 microversion: 2.1 time: 0.153354 Jan 28 20:36:48.309605 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 501/1016] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:48 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1496 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:48.406437 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-dfff7b6b-4574-47bb-b301-0164df9dd1e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:48.407123 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-dfff7b6b-4574-47bb-b301-0164df9dd1e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:48.414589 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dfff7b6b-4574-47bb-b301-0164df9dd1e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.415155 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dfff7b6b-4574-47bb-b301-0164df9dd1e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:48.415928 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dfff7b6b-4574-47bb-b301-0164df9dd1e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.416358 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dfff7b6b-4574-47bb-b301-0164df9dd1e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:48.556467 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-dfff7b6b-4574-47bb-b301-0164df9dd1e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:48.563678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-dfff7b6b-4574-47bb-b301-0164df9dd1e3 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.161169 Jan 28 20:36:48.564260 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 516/1017] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:48 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:48.654903 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6d065715-d53e-487e-b7e2-c1a6f0f928aa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:48.655521 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6d065715-d53e-487e-b7e2-c1a6f0f928aa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:48.661284 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6d065715-d53e-487e-b7e2-c1a6f0f928aa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.662331 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6d065715-d53e-487e-b7e2-c1a6f0f928aa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:48.663291 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6d065715-d53e-487e-b7e2-c1a6f0f928aa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.663733 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6d065715-d53e-487e-b7e2-c1a6f0f928aa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:48.767005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1b5ff673-4519-456e-9618-df7c60c9b9a7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:48.767583 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1b5ff673-4519-456e-9618-df7c60c9b9a7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:48.774426 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b5ff673-4519-456e-9618-df7c60c9b9a7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.774947 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b5ff673-4519-456e-9618-df7c60c9b9a7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:48.775782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b5ff673-4519-456e-9618-df7c60c9b9a7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.776364 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1b5ff673-4519-456e-9618-df7c60c9b9a7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:48.801438 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1b5ff673-4519-456e-9618-df7c60c9b9a7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:36:48.806591 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-6d065715-d53e-487e-b7e2-c1a6f0f928aa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:48.814766 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6d065715-d53e-487e-b7e2-c1a6f0f928aa tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.163490 Jan 28 20:36:48.815383 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 502/1018] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:48 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:48.875466 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1b5ff673-4519-456e-9618-df7c60c9b9a7 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 204 len: 0 microversion: 2.1 time: 0.111768 Jan 28 20:36:48.875984 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 517/1019] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:36:48 2022] DELETE /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 20:36:48.885027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-84e460b3-63d9-4ce8-996d-5e9bd75d9298 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:48.885809 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-84e460b3-63d9-4ce8-996d-5e9bd75d9298 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:48.892074 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-84e460b3-63d9-4ce8-996d-5e9bd75d9298 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.892520 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-84e460b3-63d9-4ce8-996d-5e9bd75d9298 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:48.893313 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-84e460b3-63d9-4ce8-996d-5e9bd75d9298 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:48.894077 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-84e460b3-63d9-4ce8-996d-5e9bd75d9298 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:49.028657 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-84e460b3-63d9-4ce8-996d-5e9bd75d9298 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:49.036311 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-84e460b3-63d9-4ce8-996d-5e9bd75d9298 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1502 microversion: 2.1 time: 0.155720 Jan 28 20:36:49.037378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 503/1020] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:48 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:49.580694 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-88b07146-0b9d-455c-9c57-8eae2cdbeb32 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:49.581386 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-88b07146-0b9d-455c-9c57-8eae2cdbeb32 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:49.588613 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88b07146-0b9d-455c-9c57-8eae2cdbeb32 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:49.589060 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88b07146-0b9d-455c-9c57-8eae2cdbeb32 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:49.589951 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88b07146-0b9d-455c-9c57-8eae2cdbeb32 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:49.590507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88b07146-0b9d-455c-9c57-8eae2cdbeb32 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:49.736956 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-88b07146-0b9d-455c-9c57-8eae2cdbeb32 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:49.745232 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-88b07146-0b9d-455c-9c57-8eae2cdbeb32 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.168368 Jan 28 20:36:49.745855 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 518/1021] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:49 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:49.831928 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c3dd1a91-a1c0-4b1a-8565-8d81b07b0796 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:49.832532 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c3dd1a91-a1c0-4b1a-8565-8d81b07b0796 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:49.839045 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3dd1a91-a1c0-4b1a-8565-8d81b07b0796 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:49.839491 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3dd1a91-a1c0-4b1a-8565-8d81b07b0796 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:49.840273 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3dd1a91-a1c0-4b1a-8565-8d81b07b0796 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:49.840701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c3dd1a91-a1c0-4b1a-8565-8d81b07b0796 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:49.978173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-c3dd1a91-a1c0-4b1a-8565-8d81b07b0796 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:49.985916 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c3dd1a91-a1c0-4b1a-8565-8d81b07b0796 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.157522 Jan 28 20:36:49.986771 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 504/1022] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:49 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:50.054417 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b63ac968-cbc5-43d1-99da-137daa4f7bd0 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:50.055059 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b63ac968-cbc5-43d1-99da-137daa4f7bd0 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:50.062649 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b63ac968-cbc5-43d1-99da-137daa4f7bd0 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:50.063092 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b63ac968-cbc5-43d1-99da-137daa4f7bd0 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:50.063882 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b63ac968-cbc5-43d1-99da-137daa4f7bd0 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:50.064312 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b63ac968-cbc5-43d1-99da-137daa4f7bd0 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:50.197989 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b63ac968-cbc5-43d1-99da-137daa4f7bd0 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:50.205163 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b63ac968-cbc5-43d1-99da-137daa4f7bd0 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1502 microversion: 2.1 time: 0.155286 Jan 28 20:36:50.205728 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 519/1023] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:50 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:50.761990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-83f593cc-62b1-4154-98a1-8ea9f3da19ff tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:50.762784 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-83f593cc-62b1-4154-98a1-8ea9f3da19ff tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:50.769569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-83f593cc-62b1-4154-98a1-8ea9f3da19ff tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:50.770715 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-83f593cc-62b1-4154-98a1-8ea9f3da19ff tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:50.772586 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-83f593cc-62b1-4154-98a1-8ea9f3da19ff tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:50.773229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-83f593cc-62b1-4154-98a1-8ea9f3da19ff tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:50.920170 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-83f593cc-62b1-4154-98a1-8ea9f3da19ff tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:50.927983 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-83f593cc-62b1-4154-98a1-8ea9f3da19ff tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.169786 Jan 28 20:36:50.928566 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 505/1024] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:50 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:51.003926 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b35cbdc3-3481-46da-9857-9c4b7fe7e6db tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:51.004547 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b35cbdc3-3481-46da-9857-9c4b7fe7e6db tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:51.011740 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b35cbdc3-3481-46da-9857-9c4b7fe7e6db tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:51.012246 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b35cbdc3-3481-46da-9857-9c4b7fe7e6db tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:51.012995 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b35cbdc3-3481-46da-9857-9c4b7fe7e6db tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:51.013433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b35cbdc3-3481-46da-9857-9c4b7fe7e6db tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:51.145510 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-b35cbdc3-3481-46da-9857-9c4b7fe7e6db tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:51.153396 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b35cbdc3-3481-46da-9857-9c4b7fe7e6db tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.153328 Jan 28 20:36:51.153997 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 520/1025] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:50 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:51.222070 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-81f3a258-2468-4861-ae16-87ffb044eb7c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:51.222678 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-81f3a258-2468-4861-ae16-87ffb044eb7c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:51.228771 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-81f3a258-2468-4861-ae16-87ffb044eb7c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:51.229407 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-81f3a258-2468-4861-ae16-87ffb044eb7c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:51.230314 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-81f3a258-2468-4861-ae16-87ffb044eb7c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:51.230851 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-81f3a258-2468-4861-ae16-87ffb044eb7c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:51.365957 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-81f3a258-2468-4861-ae16-87ffb044eb7c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78d2ca1ae8a4ecd8dc4545da9b51086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756fa797e7348fab2201dff5eb91ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:51.374298 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-81f3a258-2468-4861-ae16-87ffb044eb7c tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 200 len: 1502 microversion: 2.1 time: 0.155854 Jan 28 20:36:51.374877 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 506/1026] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:51 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:51.482458 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-c0e97100-cb5f-444a-b365-b291f5e81c04 req-0a120892-d5a1-4ada-8943-bd2274dbe5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "388708b6-8f50-4a4a-8649-28b2ef0853cc", "name": "network-vif-deleted", "tag": "da812586-076a-4920-8552-77b0cef95de7"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:51.485236 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:51.485236 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:36:51.495806 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-c0e97100-cb5f-444a-b365-b291f5e81c04 req-0a120892-d5a1-4ada-8943-bd2274dbe5e1 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:51.496506 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-c0e97100-cb5f-444a-b365-b291f5e81c04 req-0a120892-d5a1-4ada-8943-bd2274dbe5e1 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:51.510932 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-c0e97100-cb5f-444a-b365-b291f5e81c04 req-0a120892-d5a1-4ada-8943-bd2274dbe5e1 service nova] Creating event network-vif-deleted:da812586-076a-4920-8552-77b0cef95de7 for instance 388708b6-8f50-4a4a-8649-28b2ef0853cc on hv-cinder-82635 Jan 28 20:36:51.516344 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-c0e97100-cb5f-444a-b365-b291f5e81c04 req-0a120892-d5a1-4ada-8943-bd2274dbe5e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037458 Jan 28 20:36:51.517354 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 521/1027] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:51.948536 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b8280fd6-66bb-4981-a2e1-94a71864732a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:51.949703 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b8280fd6-66bb-4981-a2e1-94a71864732a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:51.960119 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b8280fd6-66bb-4981-a2e1-94a71864732a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:51.960929 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b8280fd6-66bb-4981-a2e1-94a71864732a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:51.962386 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b8280fd6-66bb-4981-a2e1-94a71864732a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:51.963243 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b8280fd6-66bb-4981-a2e1-94a71864732a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:52.114101 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b8280fd6-66bb-4981-a2e1-94a71864732a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:52.121938 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b8280fd6-66bb-4981-a2e1-94a71864732a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.180535 Jan 28 20:36:52.122497 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 507/1028] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:51 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:52.169646 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d6c45450-49c5-4e31-b848-e042a8dd1dbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:52.170368 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d6c45450-49c5-4e31-b848-e042a8dd1dbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:52.176671 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6c45450-49c5-4e31-b848-e042a8dd1dbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:52.177151 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6c45450-49c5-4e31-b848-e042a8dd1dbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:52.177946 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6c45450-49c5-4e31-b848-e042a8dd1dbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:52.178374 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6c45450-49c5-4e31-b848-e042a8dd1dbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:52.312195 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-d6c45450-49c5-4e31-b848-e042a8dd1dbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:52.319205 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d6c45450-49c5-4e31-b848-e042a8dd1dbe tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.153464 Jan 28 20:36:52.319758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 522/1029] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:52 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:52.391542 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7e64cf31-24a8-4e13-b5a7-eecdc72522a8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:52.392075 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-7e64cf31-24a8-4e13-b5a7-eecdc72522a8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] [instance: 388708b6-8f50-4a4a-8649-28b2ef0853cc] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:52.398661 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e64cf31-24a8-4e13-b5a7-eecdc72522a8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:52.399105 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e64cf31-24a8-4e13-b5a7-eecdc72522a8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:52.399951 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e64cf31-24a8-4e13-b5a7-eecdc72522a8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:52.400378 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-7e64cf31-24a8-4e13-b5a7-eecdc72522a8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:52.413697 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-7e64cf31-24a8-4e13-b5a7-eecdc72522a8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] HTTP exception thrown: Instance 388708b6-8f50-4a4a-8649-28b2ef0853cc could not be found. Jan 28 20:36:52.414315 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-7e64cf31-24a8-4e13-b5a7-eecdc72522a8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] Returning 404 to user: Instance 388708b6-8f50-4a4a-8649-28b2ef0853cc could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:36:52.415109 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-7e64cf31-24a8-4e13-b5a7-eecdc72522a8 tempest-VolumesActionsTest-611465140 tempest-VolumesActionsTest-611465140-project] 10.222.0.59 "GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc" status: 404 len: 111 microversion: 2.1 time: 0.027297 Jan 28 20:36:52.415621 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 508/1030] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:52 2022] GET /compute/v2.1/servers/388708b6-8f50-4a4a-8649-28b2ef0853cc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:36:53.137637 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ee046f32-7bf8-4c96-8adf-034f1b68cd88 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:53.138303 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ee046f32-7bf8-4c96-8adf-034f1b68cd88 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:53.144340 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee046f32-7bf8-4c96-8adf-034f1b68cd88 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:53.144779 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee046f32-7bf8-4c96-8adf-034f1b68cd88 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:53.145538 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee046f32-7bf8-4c96-8adf-034f1b68cd88 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:53.145991 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee046f32-7bf8-4c96-8adf-034f1b68cd88 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:53.278416 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ee046f32-7bf8-4c96-8adf-034f1b68cd88 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:53.284660 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ee046f32-7bf8-4c96-8adf-034f1b68cd88 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.150820 Jan 28 20:36:53.285210 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 523/1031] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:53 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:53.335180 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1f493bd4-a777-4cf9-a50d-d4d297c741a4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:53.335793 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1f493bd4-a777-4cf9-a50d-d4d297c741a4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:53.342143 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1f493bd4-a777-4cf9-a50d-d4d297c741a4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:53.342591 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1f493bd4-a777-4cf9-a50d-d4d297c741a4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:53.343367 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1f493bd4-a777-4cf9-a50d-d4d297c741a4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:53.343801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1f493bd4-a777-4cf9-a50d-d4d297c741a4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:53.473494 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1f493bd4-a777-4cf9-a50d-d4d297c741a4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:53.481349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1f493bd4-a777-4cf9-a50d-d4d297c741a4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.149717 Jan 28 20:36:53.481845 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 509/1032] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:53 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:54.301096 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-77581299-2e88-49eb-8b07-5a7db0c8dc43 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:54.301669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-77581299-2e88-49eb-8b07-5a7db0c8dc43 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:54.307871 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-77581299-2e88-49eb-8b07-5a7db0c8dc43 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:54.308321 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-77581299-2e88-49eb-8b07-5a7db0c8dc43 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:54.309094 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-77581299-2e88-49eb-8b07-5a7db0c8dc43 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:54.309538 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-77581299-2e88-49eb-8b07-5a7db0c8dc43 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:54.457019 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-77581299-2e88-49eb-8b07-5a7db0c8dc43 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:54.464263 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-77581299-2e88-49eb-8b07-5a7db0c8dc43 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.166920 Jan 28 20:36:54.464829 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 524/1033] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:54 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:54.498352 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0e396d69-b415-45ae-b698-405ecd1c3828 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:54.498964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0e396d69-b415-45ae-b698-405ecd1c3828 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:54.505230 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0e396d69-b415-45ae-b698-405ecd1c3828 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:54.505676 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0e396d69-b415-45ae-b698-405ecd1c3828 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:54.507066 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0e396d69-b415-45ae-b698-405ecd1c3828 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:54.507498 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0e396d69-b415-45ae-b698-405ecd1c3828 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:54.635315 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-0e396d69-b415-45ae-b698-405ecd1c3828 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:54.642515 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0e396d69-b415-45ae-b698-405ecd1c3828 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.147842 Jan 28 20:36:54.643099 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 510/1034] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:54 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:55.481143 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9cdd6480-158e-4664-a816-6c845bf87d5d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:55.481772 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9cdd6480-158e-4664-a816-6c845bf87d5d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:55.488364 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9cdd6480-158e-4664-a816-6c845bf87d5d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:55.488750 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9cdd6480-158e-4664-a816-6c845bf87d5d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:55.489601 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9cdd6480-158e-4664-a816-6c845bf87d5d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:55.490073 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9cdd6480-158e-4664-a816-6c845bf87d5d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:55.624967 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9cdd6480-158e-4664-a816-6c845bf87d5d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:55.632770 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9cdd6480-158e-4664-a816-6c845bf87d5d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.155354 Jan 28 20:36:55.633347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 525/1035] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:55 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:55.659729 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8ab13790-fdc7-4778-b741-bcde8a024503 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:55.660331 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8ab13790-fdc7-4778-b741-bcde8a024503 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:55.666764 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ab13790-fdc7-4778-b741-bcde8a024503 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:55.667209 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ab13790-fdc7-4778-b741-bcde8a024503 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:55.667988 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ab13790-fdc7-4778-b741-bcde8a024503 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:55.668417 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8ab13790-fdc7-4778-b741-bcde8a024503 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:55.798802 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8ab13790-fdc7-4778-b741-bcde8a024503 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:55.806201 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8ab13790-fdc7-4778-b741-bcde8a024503 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.150064 Jan 28 20:36:55.806774 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 511/1036] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:55 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:56.650419 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9634cd28-f83f-4fc0-a2ae-b87add57a33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:56.651217 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9634cd28-f83f-4fc0-a2ae-b87add57a33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:56.658413 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9634cd28-f83f-4fc0-a2ae-b87add57a33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:56.658856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9634cd28-f83f-4fc0-a2ae-b87add57a33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:56.659647 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9634cd28-f83f-4fc0-a2ae-b87add57a33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:56.660076 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9634cd28-f83f-4fc0-a2ae-b87add57a33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:56.735135 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-5b6318af-7391-4d13-b96a-39dbd354cf54 req-558e20d4-8326-46ec-a851-9d766be2db2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9301756-2919-4996-8f98-7004d11de728", "name": "network-vif-plugged", "status": "completed", "tag": "38d64510-69e9-4d58-b32a-547abb46e890"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:56.736728 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:56.736728 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:36:56.759246 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-5b6318af-7391-4d13-b96a-39dbd354cf54 req-558e20d4-8326-46ec-a851-9d766be2db2f service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:56.759749 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-5b6318af-7391-4d13-b96a-39dbd354cf54 req-558e20d4-8326-46ec-a851-9d766be2db2f service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:56.772640 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-5b6318af-7391-4d13-b96a-39dbd354cf54 req-558e20d4-8326-46ec-a851-9d766be2db2f service nova] Creating event network-vif-plugged:38d64510-69e9-4d58-b32a-547abb46e890 for instance e9301756-2919-4996-8f98-7004d11de728 on hv-cinder-82635 Jan 28 20:36:56.779256 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-5b6318af-7391-4d13-b96a-39dbd354cf54 req-558e20d4-8326-46ec-a851-9d766be2db2f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047616 Jan 28 20:36:56.779869 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 512/1037] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:36:56.820503 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9634cd28-f83f-4fc0-a2ae-b87add57a33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:56.823652 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-b4c8d22d-2f25-4e17-8e7a-58188c84e91d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:56.824359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-b4c8d22d-2f25-4e17-8e7a-58188c84e91d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:56.828555 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9634cd28-f83f-4fc0-a2ae-b87add57a33d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.182249 Jan 28 20:36:56.829408 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 526/1038] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:56 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:36:56.837595 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4c8d22d-2f25-4e17-8e7a-58188c84e91d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:56.838075 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4c8d22d-2f25-4e17-8e7a-58188c84e91d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:56.839291 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4c8d22d-2f25-4e17-8e7a-58188c84e91d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:56.839672 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-b4c8d22d-2f25-4e17-8e7a-58188c84e91d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:56.978631 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-b4c8d22d-2f25-4e17-8e7a-58188c84e91d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:56.986030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-b4c8d22d-2f25-4e17-8e7a-58188c84e91d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.166362 Jan 28 20:36:56.986876 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 513/1039] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:56 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:57.846392 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ed62557d-0cbd-4977-98f7-039213ec33a9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:57.846996 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ed62557d-0cbd-4977-98f7-039213ec33a9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:57.853752 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed62557d-0cbd-4977-98f7-039213ec33a9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:57.854298 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed62557d-0cbd-4977-98f7-039213ec33a9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:57.855078 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed62557d-0cbd-4977-98f7-039213ec33a9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:57.855507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ed62557d-0cbd-4977-98f7-039213ec33a9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:57.987418 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ed62557d-0cbd-4977-98f7-039213ec33a9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:57.995378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ed62557d-0cbd-4977-98f7-039213ec33a9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.152629 Jan 28 20:36:57.995939 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 527/1040] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:57 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:58.002474 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8d6155d1-0f35-415a-b55c-bd1584acb838 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:58.003082 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8d6155d1-0f35-415a-b55c-bd1584acb838 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:58.009163 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8d6155d1-0f35-415a-b55c-bd1584acb838 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:58.009603 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8d6155d1-0f35-415a-b55c-bd1584acb838 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:58.010414 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8d6155d1-0f35-415a-b55c-bd1584acb838 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:58.010840 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8d6155d1-0f35-415a-b55c-bd1584acb838 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:58.144344 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8d6155d1-0f35-415a-b55c-bd1584acb838 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:58.152015 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8d6155d1-0f35-415a-b55c-bd1584acb838 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.153123 Jan 28 20:36:58.152602 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 514/1041] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:57 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:58.797758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-34543f8e-56b7-4339-9a05-99784eaba973 req-6894e195-b5e7-4a5a-ad66-c6a9a6530982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a281ecb1-a100-4005-a1e7-0a6598b9a1b9", "name": "network-vif-plugged", "status": "completed", "tag": "24f9fcbe-ec8a-4060-9907-5cd74d8b8ffd"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:36:58.799341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:36:58.799341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:36:58.806824 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-34543f8e-56b7-4339-9a05-99784eaba973 req-6894e195-b5e7-4a5a-ad66-c6a9a6530982 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:58.807269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-34543f8e-56b7-4339-9a05-99784eaba973 req-6894e195-b5e7-4a5a-ad66-c6a9a6530982 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:58.817462 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-34543f8e-56b7-4339-9a05-99784eaba973 req-6894e195-b5e7-4a5a-ad66-c6a9a6530982 service nova] Creating event network-vif-plugged:24f9fcbe-ec8a-4060-9907-5cd74d8b8ffd for instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 on hv-cinder-82635 Jan 28 20:36:58.822457 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-34543f8e-56b7-4339-9a05-99784eaba973 req-6894e195-b5e7-4a5a-ad66-c6a9a6530982 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028236 Jan 28 20:36:58.823027 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 528/1042] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:36:59.012198 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d3b6d281-3ada-4dd2-a894-1f5f65926d49 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:59.012795 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d3b6d281-3ada-4dd2-a894-1f5f65926d49 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:59.019241 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3b6d281-3ada-4dd2-a894-1f5f65926d49 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:59.019684 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3b6d281-3ada-4dd2-a894-1f5f65926d49 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:59.020455 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3b6d281-3ada-4dd2-a894-1f5f65926d49 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:59.020883 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d3b6d281-3ada-4dd2-a894-1f5f65926d49 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:59.153374 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d3b6d281-3ada-4dd2-a894-1f5f65926d49 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:59.160623 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d3b6d281-3ada-4dd2-a894-1f5f65926d49 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.152479 Jan 28 20:36:59.161184 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 515/1043] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:59 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:36:59.170119 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ea3c4c67-142b-4035-9a43-85b0a4a57e4f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:36:59.170871 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ea3c4c67-142b-4035-9a43-85b0a4a57e4f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:36:59.177176 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ea3c4c67-142b-4035-9a43-85b0a4a57e4f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:59.177627 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ea3c4c67-142b-4035-9a43-85b0a4a57e4f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:59.178466 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ea3c4c67-142b-4035-9a43-85b0a4a57e4f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:36:59.178904 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ea3c4c67-142b-4035-9a43-85b0a4a57e4f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:36:59.320594 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ea3c4c67-142b-4035-9a43-85b0a4a57e4f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:36:59.327860 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ea3c4c67-142b-4035-9a43-85b0a4a57e4f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.162312 Jan 28 20:36:59.328425 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 529/1044] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:36:59 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:00.176765 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4fd5d064-c169-48e1-9e18-661d39f2d537 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:00.177372 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4fd5d064-c169-48e1-9e18-661d39f2d537 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:00.184213 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4fd5d064-c169-48e1-9e18-661d39f2d537 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:00.184656 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4fd5d064-c169-48e1-9e18-661d39f2d537 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:00.185440 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4fd5d064-c169-48e1-9e18-661d39f2d537 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:00.185900 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4fd5d064-c169-48e1-9e18-661d39f2d537 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:00.316487 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4fd5d064-c169-48e1-9e18-661d39f2d537 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:00.323671 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4fd5d064-c169-48e1-9e18-661d39f2d537 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.150577 Jan 28 20:37:00.324223 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 516/1045] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:00 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:00.344107 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-78570263-66e9-43a1-8f65-4685e17b4919 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:00.344709 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-78570263-66e9-43a1-8f65-4685e17b4919 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:00.351565 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-78570263-66e9-43a1-8f65-4685e17b4919 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:00.352010 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-78570263-66e9-43a1-8f65-4685e17b4919 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:00.352782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-78570263-66e9-43a1-8f65-4685e17b4919 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:00.353212 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-78570263-66e9-43a1-8f65-4685e17b4919 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:00.481231 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-78570263-66e9-43a1-8f65-4685e17b4919 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:00.488333 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-78570263-66e9-43a1-8f65-4685e17b4919 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.147825 Jan 28 20:37:00.488894 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 530/1046] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:00 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:01.341353 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-46943ec3-f309-4600-ba9c-aa23c1af9adc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:01.342173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-46943ec3-f309-4600-ba9c-aa23c1af9adc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:01.349742 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46943ec3-f309-4600-ba9c-aa23c1af9adc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:01.350450 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46943ec3-f309-4600-ba9c-aa23c1af9adc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:01.351474 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46943ec3-f309-4600-ba9c-aa23c1af9adc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:01.351914 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-46943ec3-f309-4600-ba9c-aa23c1af9adc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:01.505485 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-42f4c209-34de-48ff-9f57-e651243be7ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:01.506994 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-42f4c209-34de-48ff-9f57-e651243be7ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:01.514638 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-46943ec3-f309-4600-ba9c-aa23c1af9adc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:01.525013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-42f4c209-34de-48ff-9f57-e651243be7ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:01.525549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-46943ec3-f309-4600-ba9c-aa23c1af9adc tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1264 microversion: 2.1 time: 0.185279 Jan 28 20:37:01.526214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 517/1047] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:01 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:01.526613 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-42f4c209-34de-48ff-9f57-e651243be7ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:01.527432 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-42f4c209-34de-48ff-9f57-e651243be7ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:01.527872 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-42f4c209-34de-48ff-9f57-e651243be7ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:01.674804 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-42f4c209-34de-48ff-9f57-e651243be7ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:01.683483 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-42f4c209-34de-48ff-9f57-e651243be7ca tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1362 microversion: 2.1 time: 0.181969 Jan 28 20:37:01.684066 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 531/1048] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:01 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:02.542197 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3cd2c119-32c5-4ec9-bdfb-63f6ba5faf94 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:02.542741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-3cd2c119-32c5-4ec9-bdfb-63f6ba5faf94 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:02.552039 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3cd2c119-32c5-4ec9-bdfb-63f6ba5faf94 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:02.553357 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3cd2c119-32c5-4ec9-bdfb-63f6ba5faf94 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:02.555788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3cd2c119-32c5-4ec9-bdfb-63f6ba5faf94 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:02.556752 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-3cd2c119-32c5-4ec9-bdfb-63f6ba5faf94 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:02.703643 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7e89b86c-ce56-4330-9acb-119e9b449350 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:02.705098 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7e89b86c-ce56-4330-9acb-119e9b449350 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:02.714595 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e89b86c-ce56-4330-9acb-119e9b449350 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:02.715470 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e89b86c-ce56-4330-9acb-119e9b449350 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:02.716666 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e89b86c-ce56-4330-9acb-119e9b449350 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:02.717505 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e89b86c-ce56-4330-9acb-119e9b449350 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:02.721973 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-3cd2c119-32c5-4ec9-bdfb-63f6ba5faf94 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:02.730386 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3cd2c119-32c5-4ec9-bdfb-63f6ba5faf94 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1452 microversion: 2.1 time: 0.192237 Jan 28 20:37:02.731262 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 518/1049] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:02 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:02.751743 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8019bfd8-f975-4508-87a6-dccf6d52fbe0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:02.752874 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8019bfd8-f975-4508-87a6-dccf6d52fbe0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:02.770143 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8019bfd8-f975-4508-87a6-dccf6d52fbe0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:02.770740 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8019bfd8-f975-4508-87a6-dccf6d52fbe0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:02.771561 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8019bfd8-f975-4508-87a6-dccf6d52fbe0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:02.772036 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8019bfd8-f975-4508-87a6-dccf6d52fbe0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:02.946779 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7e89b86c-ce56-4330-9acb-119e9b449350 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:02.982349 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7e89b86c-ce56-4330-9acb-119e9b449350 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1549 microversion: 2.1 time: 0.285375 Jan 28 20:37:02.983221 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 532/1050] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:02 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1549 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:37:02.998357 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3b13ead2-3320-4bd3-869e-1cb15d2ac343 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:02.999775 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3b13ead2-3320-4bd3-869e-1cb15d2ac343 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:03.008015 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3b13ead2-3320-4bd3-869e-1cb15d2ac343 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:03.008815 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3b13ead2-3320-4bd3-869e-1cb15d2ac343 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:03.010406 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3b13ead2-3320-4bd3-869e-1cb15d2ac343 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:03.011084 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3b13ead2-3320-4bd3-869e-1cb15d2ac343 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:03.053793 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8019bfd8-f975-4508-87a6-dccf6d52fbe0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:03.061323 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8019bfd8-f975-4508-87a6-dccf6d52fbe0 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1452 microversion: 2.1 time: 0.313520 Jan 28 20:37:03.074034 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 519/1051] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:02 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1452 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:37:03.141773 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3b13ead2-3320-4bd3-869e-1cb15d2ac343 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147060 Jan 28 20:37:03.155910 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 533/1052] 10.222.0.59 () {58 vars in 1274 bytes} [Fri Jan 28 20:37:02 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:37:04.603134 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-54bb090a-d136-45f6-9722-1f61ce6fe2e2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:04.603651 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-54bb090a-d136-45f6-9722-1f61ce6fe2e2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:04.606055 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-eb74469b-97ac-4503-822b-cbf7a68028ca req-a192ecd7-ae47-4ec2-b320-c17e2e65b7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a281ecb1-a100-4005-a1e7-0a6598b9a1b9", "tag": "24f9fcbe-ec8a-4060-9907-5cd74d8b8ffd"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:37:04.608556 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:37:04.608556 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:37:04.610176 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-54bb090a-d136-45f6-9722-1f61ce6fe2e2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:04.610820 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-54bb090a-d136-45f6-9722-1f61ce6fe2e2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:04.611792 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-54bb090a-d136-45f6-9722-1f61ce6fe2e2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:04.612396 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-54bb090a-d136-45f6-9722-1f61ce6fe2e2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:04.619952 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-eb74469b-97ac-4503-822b-cbf7a68028ca req-a192ecd7-ae47-4ec2-b320-c17e2e65b7b0 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:04.620695 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-eb74469b-97ac-4503-822b-cbf7a68028ca req-a192ecd7-ae47-4ec2-b320-c17e2e65b7b0 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:04.635396 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-eb74469b-97ac-4503-822b-cbf7a68028ca req-a192ecd7-ae47-4ec2-b320-c17e2e65b7b0 service nova] Creating event network-changed:24f9fcbe-ec8a-4060-9907-5cd74d8b8ffd for instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 on hv-cinder-82635 Jan 28 20:37:04.642946 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-eb74469b-97ac-4503-822b-cbf7a68028ca req-a192ecd7-ae47-4ec2-b320-c17e2e65b7b0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041219 Jan 28 20:37:04.645287 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 534/1053] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:37:04.646132 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-54bb090a-d136-45f6-9722-1f61ce6fe2e2 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/ips" status: 200 len: 107 microversion: 2.1 time: 0.046628 Jan 28 20:37:04.648295 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 520/1054] 10.222.0.59 () {58 vars in 1247 bytes} [Fri Jan 28 20:37:04 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/ips => generated 107 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:37:05.239408 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-615940831", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-224574802", "security_groups": [{"name": "tempest-secgroup-smoke-1594074015"}], "networks": [{"uuid": "5766e274-9f40-4571-acf2-007f34b68f9b"}], "block_device_mapping_v2": [{"uuid": "5fbc1ff1-ad5d-461c-bb05-c53736cb8abe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:37:05.450206 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.network.neutron [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] validate_networks() for [('5766e274-9f40-4571-acf2-007f34b68f9b', None, None, None, None, None)] {{(pid=116276) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 20:37:06.186105 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2a9f2960-62be-48cb-b0d4-33dd474356f3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ca317e7-d8a9-499f-81c0-f0a44c7f6561"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:37:06.187207 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2a9f2960-62be-48cb-b0d4-33dd474356f3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:06.200238 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2a9f2960-62be-48cb-b0d4-33dd474356f3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:06.200695 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2a9f2960-62be-48cb-b0d4-33dd474356f3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:06.201523 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2a9f2960-62be-48cb-b0d4-33dd474356f3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:06.202175 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2a9f2960-62be-48cb-b0d4-33dd474356f3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:06.382666 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Flavor limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 20:37:06.384124 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Image limits 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 20:37:06.385029 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Flavor pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 20:37:06.385782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Image pref 0:0:0 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 20:37:06.386510 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.virt.hardware [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 20:37:06.430360 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:06.431088 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:06.434457 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:06.436282 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:06.464194 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Getting quotas for project ae0bc0d163664eefa8c2c16ca7a80896. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 20:37:06.469074 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.quota [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Getting quotas for user 8bfbac7ec87a40dab1aad77948afcfd5 and project ae0bc0d163664eefa8c2c16ca7a80896. Resources: {'ram', 'cores', 'instances'} {{(pid=116276) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 20:37:06.567025 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Going to run 1 instances... {{(pid=116276) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 20:37:06.572427 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5fbc1ff1-ad5d-461c-bb05-c53736cb8abe',volume_size=None,volume_type=None)] {{(pid=116276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 20:37:06.635315 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2a9f2960-62be-48cb-b0d4-33dd474356f3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452492 Jan 28 20:37:06.641646 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 521/1055] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:37:06 2022] POST /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:37:06.659077 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-c137e1e3-e565-4cf1-b5ae-7866c5730988 req-c97dccca-873f-4514-9bbe-0e7aaea31784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9301756-2919-4996-8f98-7004d11de728", "tag": "38d64510-69e9-4d58-b32a-547abb46e890"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:37:06.670186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:37:06.670186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:37:06.690224 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-c137e1e3-e565-4cf1-b5ae-7866c5730988 req-c97dccca-873f-4514-9bbe-0e7aaea31784 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:06.691200 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-c137e1e3-e565-4cf1-b5ae-7866c5730988 req-c97dccca-873f-4514-9bbe-0e7aaea31784 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:06.727829 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-c137e1e3-e565-4cf1-b5ae-7866c5730988 req-c97dccca-873f-4514-9bbe-0e7aaea31784 service nova] Creating event network-changed:38d64510-69e9-4d58-b32a-547abb46e890 for instance e9301756-2919-4996-8f98-7004d11de728 on hv-cinder-82635 Jan 28 20:37:06.741896 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-c137e1e3-e565-4cf1-b5ae-7866c5730988 req-c97dccca-873f-4514-9bbe-0e7aaea31784 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095358 Jan 28 20:37:06.742844 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 522/1056] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:37:06.887967 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d6b9b9bd-7198-4edc-965b-087d012e53ba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.653208 Jan 28 20:37:06.894749 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 535/1057] 10.222.0.59 () {60 vars in 1146 bytes} [Fri Jan 28 20:37:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 20:37:06.902832 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a5abdd76-d57e-44bc-ae79-bbd17cb07058 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:06.903555 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a5abdd76-d57e-44bc-ae79-bbd17cb07058 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:07.041495 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-a5abdd76-d57e-44bc-ae79-bbd17cb07058 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:07.049363 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a5abdd76-d57e-44bc-ae79-bbd17cb07058 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1087 microversion: 2.1 time: 0.153026 Jan 28 20:37:07.050330 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 523/1058] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:06 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1087 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:08.077121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-88c53561-742a-494e-b9a7-f4cc2155911a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:08.077898 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-88c53561-742a-494e-b9a7-f4cc2155911a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:08.086434 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88c53561-742a-494e-b9a7-f4cc2155911a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:08.087017 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88c53561-742a-494e-b9a7-f4cc2155911a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:08.087962 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88c53561-742a-494e-b9a7-f4cc2155911a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:08.089318 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-88c53561-742a-494e-b9a7-f4cc2155911a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:08.187677 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-88c53561-742a-494e-b9a7-f4cc2155911a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:08.198170 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-88c53561-742a-494e-b9a7-f4cc2155911a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1193 microversion: 2.1 time: 0.126557 Jan 28 20:37:08.199109 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 536/1059] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:08 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1193 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:09.220031 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-766eb925-b5cd-4549-851d-749c1ac35acc tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:09.221609 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-766eb925-b5cd-4549-851d-749c1ac35acc tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:09.231339 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-766eb925-b5cd-4549-851d-749c1ac35acc tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:09.231978 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-766eb925-b5cd-4549-851d-749c1ac35acc tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:09.232978 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-766eb925-b5cd-4549-851d-749c1ac35acc tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:09.233849 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-766eb925-b5cd-4549-851d-749c1ac35acc tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:09.415954 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-766eb925-b5cd-4549-851d-749c1ac35acc tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:09.425135 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-766eb925-b5cd-4549-851d-749c1ac35acc tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1271 microversion: 2.1 time: 0.212564 Jan 28 20:37:09.426283 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 524/1060] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:09 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:37:10.045228 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-3dcfde58-2d89-461d-8a9d-2324e47d64e4 req-21ae6b3a-e0f1-4a2b-8906-a04b0f866971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a83d58a-2acb-4ab1-af31-f8932d53f384", "tag": "29aa8a32-9948-4e90-af5d-9ac2ff31e4f0"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:37:10.047035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:37:10.047035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:37:10.059121 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-3dcfde58-2d89-461d-8a9d-2324e47d64e4 req-21ae6b3a-e0f1-4a2b-8906-a04b0f866971 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:10.059819 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-3dcfde58-2d89-461d-8a9d-2324e47d64e4 req-21ae6b3a-e0f1-4a2b-8906-a04b0f866971 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:10.073194 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-3dcfde58-2d89-461d-8a9d-2324e47d64e4 req-21ae6b3a-e0f1-4a2b-8906-a04b0f866971 service nova] Creating event network-changed:29aa8a32-9948-4e90-af5d-9ac2ff31e4f0 for instance 1a83d58a-2acb-4ab1-af31-f8932d53f384 on hv-cinder-82635 Jan 28 20:37:10.080153 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-3dcfde58-2d89-461d-8a9d-2324e47d64e4 req-21ae6b3a-e0f1-4a2b-8906-a04b0f866971 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037391 Jan 28 20:37:10.081783 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 537/1061] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:37:10.442801 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4c05cc5e-4105-4285-90fe-656eeded08f2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:10.443584 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4c05cc5e-4105-4285-90fe-656eeded08f2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:10.455079 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4c05cc5e-4105-4285-90fe-656eeded08f2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:10.456276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4c05cc5e-4105-4285-90fe-656eeded08f2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:10.457578 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4c05cc5e-4105-4285-90fe-656eeded08f2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:10.458380 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4c05cc5e-4105-4285-90fe-656eeded08f2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:10.674232 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4c05cc5e-4105-4285-90fe-656eeded08f2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:10.682834 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4c05cc5e-4105-4285-90fe-656eeded08f2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1271 microversion: 2.1 time: 0.243774 Jan 28 20:37:10.694149 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 525/1062] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:10 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:11.701398 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7e6e7ab4-d24b-4e21-8859-3c3e55c7ac5c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:11.702377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7e6e7ab4-d24b-4e21-8859-3c3e55c7ac5c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:11.715679 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e6e7ab4-d24b-4e21-8859-3c3e55c7ac5c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:11.716273 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e6e7ab4-d24b-4e21-8859-3c3e55c7ac5c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:11.717075 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e6e7ab4-d24b-4e21-8859-3c3e55c7ac5c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:11.717543 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7e6e7ab4-d24b-4e21-8859-3c3e55c7ac5c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:11.872737 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7e6e7ab4-d24b-4e21-8859-3c3e55c7ac5c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:11.880212 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7e6e7ab4-d24b-4e21-8859-3c3e55c7ac5c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1271 microversion: 2.1 time: 0.182839 Jan 28 20:37:11.889787 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 538/1063] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:11 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:12.898010 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d51b8b67-936b-477c-9524-4dc0ac400fa5 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:12.899362 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d51b8b67-936b-477c-9524-4dc0ac400fa5 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:12.909241 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d51b8b67-936b-477c-9524-4dc0ac400fa5 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:12.911178 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d51b8b67-936b-477c-9524-4dc0ac400fa5 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:12.912229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d51b8b67-936b-477c-9524-4dc0ac400fa5 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:12.913788 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d51b8b67-936b-477c-9524-4dc0ac400fa5 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:13.119549 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-d51b8b67-936b-477c-9524-4dc0ac400fa5 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:13.130083 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d51b8b67-936b-477c-9524-4dc0ac400fa5 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1271 microversion: 2.1 time: 0.236348 Jan 28 20:37:13.130934 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 526/1064] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:12 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:14.150223 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-2218388b-9de2-4500-a266-b2765a13c6ec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:14.157127 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-2218388b-9de2-4500-a266-b2765a13c6ec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:14.168566 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2218388b-9de2-4500-a266-b2765a13c6ec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:14.169431 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2218388b-9de2-4500-a266-b2765a13c6ec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:14.170781 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2218388b-9de2-4500-a266-b2765a13c6ec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:14.171579 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-2218388b-9de2-4500-a266-b2765a13c6ec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:14.299027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-20e1231e-527b-4b0d-ae67-74f3afe84e5b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:14.300234 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-20e1231e-527b-4b0d-ae67-74f3afe84e5b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:14.307963 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20e1231e-527b-4b0d-ae67-74f3afe84e5b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:14.314711 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20e1231e-527b-4b0d-ae67-74f3afe84e5b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:14.315660 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20e1231e-527b-4b0d-ae67-74f3afe84e5b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:14.316213 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-20e1231e-527b-4b0d-ae67-74f3afe84e5b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:14.366609 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-20e1231e-527b-4b0d-ae67-74f3afe84e5b tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070608 Jan 28 20:37:14.368054 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 527/1065] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:37:14 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:37:14.390747 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ff8057d9-1d94-4d05-ac47-b4585bdb94c3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:14.393590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ff8057d9-1d94-4d05-ac47-b4585bdb94c3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:14.406231 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ff8057d9-1d94-4d05-ac47-b4585bdb94c3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:14.407437 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ff8057d9-1d94-4d05-ac47-b4585bdb94c3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:14.408457 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ff8057d9-1d94-4d05-ac47-b4585bdb94c3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:14.410281 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ff8057d9-1d94-4d05-ac47-b4585bdb94c3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:14.420519 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-2218388b-9de2-4500-a266-b2765a13c6ec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:14.435610 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-2218388b-9de2-4500-a266-b2765a13c6ec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1271 microversion: 2.1 time: 0.290900 Jan 28 20:37:14.436506 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 539/1066] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:14 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:14.468030 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ff8057d9-1d94-4d05-ac47-b4585bdb94c3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/5ca317e7-d8a9-499f-81c0-f0a44c7f6561" status: 200 len: 194 microversion: 2.1 time: 0.087565 Jan 28 20:37:14.468639 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 528/1067] 10.222.0.59 () {58 vars in 1412 bytes} [Fri Jan 28 20:37:14 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/5ca317e7-d8a9-499f-81c0-f0a44c7f6561 => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:37:15.456439 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0bd49998-141c-4d7b-b092-4678c7d4d7ea tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:15.458603 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0bd49998-141c-4d7b-b092-4678c7d4d7ea tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:15.467526 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0bd49998-141c-4d7b-b092-4678c7d4d7ea tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:15.468247 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0bd49998-141c-4d7b-b092-4678c7d4d7ea tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:15.469902 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0bd49998-141c-4d7b-b092-4678c7d4d7ea tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:15.470783 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0bd49998-141c-4d7b-b092-4678c7d4d7ea tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:15.652451 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0bd49998-141c-4d7b-b092-4678c7d4d7ea tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:15.665760 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0bd49998-141c-4d7b-b092-4678c7d4d7ea tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.214359 Jan 28 20:37:15.667338 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 540/1068] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:15 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:15.860364 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2fe909ee-4b37-45b5-8e90-759ea62fc019 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e13b4d04-05c7-4666-acd6-e9e7e0e6c08f"}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:37:15.861416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2fe909ee-4b37-45b5-8e90-759ea62fc019 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:15.868767 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2fe909ee-4b37-45b5-8e90-759ea62fc019 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:15.869307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2fe909ee-4b37-45b5-8e90-759ea62fc019 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:15.870375 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2fe909ee-4b37-45b5-8e90-759ea62fc019 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:15.871032 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2fe909ee-4b37-45b5-8e90-759ea62fc019 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:16.185459 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2fe909ee-4b37-45b5-8e90-759ea62fc019 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "POST /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328909 Jan 28 20:37:16.191948 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 529/1069] 10.222.0.59 () {60 vars in 1322 bytes} [Fri Jan 28 20:37:15 2022] POST /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:37:16.685429 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-270a1553-e5e5-4cf6-bde7-504908549b11 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:16.686278 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-270a1553-e5e5-4cf6-bde7-504908549b11 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:16.695593 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-270a1553-e5e5-4cf6-bde7-504908549b11 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:16.696047 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-270a1553-e5e5-4cf6-bde7-504908549b11 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:16.697019 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-270a1553-e5e5-4cf6-bde7-504908549b11 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:16.697459 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-270a1553-e5e5-4cf6-bde7-504908549b11 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:16.865060 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-270a1553-e5e5-4cf6-bde7-504908549b11 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:16.873120 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-270a1553-e5e5-4cf6-bde7-504908549b11 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.191780 Jan 28 20:37:16.873916 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 541/1070] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:16 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:17.890577 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-77d3c54b-f853-4b10-871e-73e5112c9273 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:17.891283 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-77d3c54b-f853-4b10-871e-73e5112c9273 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:17.897990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-77d3c54b-f853-4b10-871e-73e5112c9273 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:17.898646 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-77d3c54b-f853-4b10-871e-73e5112c9273 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:17.899384 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-77d3c54b-f853-4b10-871e-73e5112c9273 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:17.899887 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-77d3c54b-f853-4b10-871e-73e5112c9273 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:18.048620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-77d3c54b-f853-4b10-871e-73e5112c9273 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:18.056590 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-77d3c54b-f853-4b10-871e-73e5112c9273 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.170153 Jan 28 20:37:18.057126 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 530/1071] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:17 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:19.073556 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-60d5d424-297c-4406-a9d8-e6332f0deba2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:19.074211 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-60d5d424-297c-4406-a9d8-e6332f0deba2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:19.080486 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-60d5d424-297c-4406-a9d8-e6332f0deba2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:19.080929 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-60d5d424-297c-4406-a9d8-e6332f0deba2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:19.081694 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-60d5d424-297c-4406-a9d8-e6332f0deba2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:19.082152 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-60d5d424-297c-4406-a9d8-e6332f0deba2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:19.214275 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-60d5d424-297c-4406-a9d8-e6332f0deba2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:19.221425 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-60d5d424-297c-4406-a9d8-e6332f0deba2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.152050 Jan 28 20:37:19.222098 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 542/1072] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:19 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:20.239374 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e8e437f4-4a98-4ec2-ac1b-7534538b7d12 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:20.240825 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e8e437f4-4a98-4ec2-ac1b-7534538b7d12 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:20.248027 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e8e437f4-4a98-4ec2-ac1b-7534538b7d12 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:20.248894 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e8e437f4-4a98-4ec2-ac1b-7534538b7d12 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:20.249923 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e8e437f4-4a98-4ec2-ac1b-7534538b7d12 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:20.250558 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e8e437f4-4a98-4ec2-ac1b-7534538b7d12 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:20.408689 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e8e437f4-4a98-4ec2-ac1b-7534538b7d12 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:20.417295 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e8e437f4-4a98-4ec2-ac1b-7534538b7d12 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.182149 Jan 28 20:37:20.417897 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 531/1073] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:20 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:21.438473 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3225cb06-bb59-4b84-a7c2-78e882660fe7 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:21.439112 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3225cb06-bb59-4b84-a7c2-78e882660fe7 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:21.445423 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3225cb06-bb59-4b84-a7c2-78e882660fe7 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:21.445894 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3225cb06-bb59-4b84-a7c2-78e882660fe7 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:21.446684 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3225cb06-bb59-4b84-a7c2-78e882660fe7 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:21.447134 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3225cb06-bb59-4b84-a7c2-78e882660fe7 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:21.579005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3225cb06-bb59-4b84-a7c2-78e882660fe7 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:21.586673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3225cb06-bb59-4b84-a7c2-78e882660fe7 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.151917 Jan 28 20:37:21.587234 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 543/1074] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:21 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:22.603580 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-31590fa4-322b-498b-b379-b157d1934a03 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:22.604186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-31590fa4-322b-498b-b379-b157d1934a03 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:22.610520 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-31590fa4-322b-498b-b379-b157d1934a03 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:22.610964 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-31590fa4-322b-498b-b379-b157d1934a03 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:22.611741 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-31590fa4-322b-498b-b379-b157d1934a03 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:22.612173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-31590fa4-322b-498b-b379-b157d1934a03 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:22.756980 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-31590fa4-322b-498b-b379-b157d1934a03 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:22.764442 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-31590fa4-322b-498b-b379-b157d1934a03 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.164986 Jan 28 20:37:22.765020 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 532/1075] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:22 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:23.677911 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-86593e87-80c5-47d1-848e-1a4e87ca518f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:23.679012 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-86593e87-80c5-47d1-848e-1a4e87ca518f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:23.685601 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-86593e87-80c5-47d1-848e-1a4e87ca518f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:23.686091 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-86593e87-80c5-47d1-848e-1a4e87ca518f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:23.687077 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-86593e87-80c5-47d1-848e-1a4e87ca518f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:23.687506 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-86593e87-80c5-47d1-848e-1a4e87ca518f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:23.723827 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-86593e87-80c5-47d1-848e-1a4e87ca518f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049827 Jan 28 20:37:23.724394 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 544/1076] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:37:23 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:37:23.781816 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9d26b913-27eb-4da4-8cc4-74339243b03a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:23.782454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-9d26b913-27eb-4da4-8cc4-74339243b03a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:23.788717 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9d26b913-27eb-4da4-8cc4-74339243b03a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:23.789210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9d26b913-27eb-4da4-8cc4-74339243b03a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:23.789953 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9d26b913-27eb-4da4-8cc4-74339243b03a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:23.790384 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-9d26b913-27eb-4da4-8cc4-74339243b03a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:23.926482 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-9d26b913-27eb-4da4-8cc4-74339243b03a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:23.933920 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9d26b913-27eb-4da4-8cc4-74339243b03a tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.155735 Jan 28 20:37:23.934491 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 533/1077] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:23 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:24.878786 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-870e188d-fde1-4fb8-84be-2aa0dae14bcd req-9ef20ad3-b4ab-4d2a-88fb-7b08c09b086e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a83d58a-2acb-4ab1-af31-f8932d53f384", "name": "network-vif-plugged", "status": "completed", "tag": "29aa8a32-9948-4e90-af5d-9ac2ff31e4f0"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:37:24.880565 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:37:24.880565 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:37:24.889242 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-870e188d-fde1-4fb8-84be-2aa0dae14bcd req-9ef20ad3-b4ab-4d2a-88fb-7b08c09b086e service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:24.889710 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-870e188d-fde1-4fb8-84be-2aa0dae14bcd req-9ef20ad3-b4ab-4d2a-88fb-7b08c09b086e service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:24.902855 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-870e188d-fde1-4fb8-84be-2aa0dae14bcd req-9ef20ad3-b4ab-4d2a-88fb-7b08c09b086e service nova] Creating event network-vif-plugged:29aa8a32-9948-4e90-af5d-9ac2ff31e4f0 for instance 1a83d58a-2acb-4ab1-af31-f8932d53f384 on hv-cinder-82635 Jan 28 20:37:24.907985 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-870e188d-fde1-4fb8-84be-2aa0dae14bcd req-9ef20ad3-b4ab-4d2a-88fb-7b08c09b086e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032742 Jan 28 20:37:24.908746 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 545/1078] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:37:24.951400 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-0bf96951-46ba-4ab4-aae5-2ccb0f9c8699 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:24.952017 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-0bf96951-46ba-4ab4-aae5-2ccb0f9c8699 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:24.958904 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0bf96951-46ba-4ab4-aae5-2ccb0f9c8699 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:24.959357 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0bf96951-46ba-4ab4-aae5-2ccb0f9c8699 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:24.960708 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0bf96951-46ba-4ab4-aae5-2ccb0f9c8699 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:24.961190 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-0bf96951-46ba-4ab4-aae5-2ccb0f9c8699 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:25.100435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-0bf96951-46ba-4ab4-aae5-2ccb0f9c8699 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:25.108111 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-0bf96951-46ba-4ab4-aae5-2ccb0f9c8699 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.161083 Jan 28 20:37:25.108848 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 534/1079] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:24 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:26.124784 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-3f856ba7-79f7-40d1-b0fd-bd3e74fb5c51 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:26.125554 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-3f856ba7-79f7-40d1-b0fd-bd3e74fb5c51 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:26.132027 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3f856ba7-79f7-40d1-b0fd-bd3e74fb5c51 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:26.132476 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3f856ba7-79f7-40d1-b0fd-bd3e74fb5c51 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:26.133258 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3f856ba7-79f7-40d1-b0fd-bd3e74fb5c51 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:26.133687 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-3f856ba7-79f7-40d1-b0fd-bd3e74fb5c51 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:26.268636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-3f856ba7-79f7-40d1-b0fd-bd3e74fb5c51 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:26.276406 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-3f856ba7-79f7-40d1-b0fd-bd3e74fb5c51 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1259 microversion: 2.1 time: 0.155656 Jan 28 20:37:26.276973 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 546/1080] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:26 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:27.292266 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-8615de6c-e9fb-49c4-bb49-2d607e7dc5c1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:27.292795 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-8615de6c-e9fb-49c4-bb49-2d607e7dc5c1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:27.299104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8615de6c-e9fb-49c4-bb49-2d607e7dc5c1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:27.299551 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8615de6c-e9fb-49c4-bb49-2d607e7dc5c1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:27.300346 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8615de6c-e9fb-49c4-bb49-2d607e7dc5c1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:27.300774 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-8615de6c-e9fb-49c4-bb49-2d607e7dc5c1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:27.432914 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-8615de6c-e9fb-49c4-bb49-2d607e7dc5c1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:27.440176 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-8615de6c-e9fb-49c4-bb49-2d607e7dc5c1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1444 microversion: 2.1 time: 0.151650 Jan 28 20:37:27.440739 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 535/1081] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:27 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:27.456248 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ff63cb76-943c-4bd1-90b1-704ef6f8cc33 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:37:27.456875 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ff63cb76-943c-4bd1-90b1-704ef6f8cc33 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:37:27.463282 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ff63cb76-943c-4bd1-90b1-704ef6f8cc33 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:27.463732 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ff63cb76-943c-4bd1-90b1-704ef6f8cc33 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:27.464544 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ff63cb76-943c-4bd1-90b1-704ef6f8cc33 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:27.464980 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ff63cb76-943c-4bd1-90b1-704ef6f8cc33 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:27.599005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ff63cb76-943c-4bd1-90b1-704ef6f8cc33 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:37:27.606326 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ff63cb76-943c-4bd1-90b1-704ef6f8cc33 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1444 microversion: 2.1 time: 0.153646 Jan 28 20:37:27.606896 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 547/1082] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:37:27 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:37:29.522841 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-eedc7507-14d9-41a6-aaef-6d1d5b7f9bd9 req-5cd62f74-60da-4d39-857f-bf120291ae5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a83d58a-2acb-4ab1-af31-f8932d53f384", "tag": "29aa8a32-9948-4e90-af5d-9ac2ff31e4f0"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:37:29.523381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:37:29.523381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:37:29.530682 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-eedc7507-14d9-41a6-aaef-6d1d5b7f9bd9 req-5cd62f74-60da-4d39-857f-bf120291ae5d service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:37:29.531128 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-eedc7507-14d9-41a6-aaef-6d1d5b7f9bd9 req-5cd62f74-60da-4d39-857f-bf120291ae5d service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:37:29.542232 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-eedc7507-14d9-41a6-aaef-6d1d5b7f9bd9 req-5cd62f74-60da-4d39-857f-bf120291ae5d service nova] Creating event network-changed:29aa8a32-9948-4e90-af5d-9ac2ff31e4f0 for instance 1a83d58a-2acb-4ab1-af31-f8932d53f384 on hv-cinder-82635 Jan 28 20:37:29.547275 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-eedc7507-14d9-41a6-aaef-6d1d5b7f9bd9 req-5cd62f74-60da-4d39-857f-bf120291ae5d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029831 Jan 28 20:37:29.547946 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 536/1083] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:33.545103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9edd77a2-8336-497f-9d71-12264409ba69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:33.545689 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9edd77a2-8336-497f-9d71-12264409ba69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:33.551377 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9edd77a2-8336-497f-9d71-12264409ba69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:33.551821 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9edd77a2-8336-497f-9d71-12264409ba69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:33.552586 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9edd77a2-8336-497f-9d71-12264409ba69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:33.553009 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9edd77a2-8336-497f-9d71-12264409ba69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:33.580009 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9edd77a2-8336-497f-9d71-12264409ba69 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/5ca317e7-d8a9-499f-81c0-f0a44c7f6561" status: 200 len: 194 microversion: 2.1 time: 0.040303 Jan 28 20:38:33.580563 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 548/1084] 10.222.0.59 () {58 vars in 1412 bytes} [Fri Jan 28 20:38:33 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/5ca317e7-d8a9-499f-81c0-f0a44c7f6561 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:33.593701 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f4fe7849-c121-4e67-88cf-afbfb2c7bfd6 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:33.594390 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f4fe7849-c121-4e67-88cf-afbfb2c7bfd6 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:33.600416 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f4fe7849-c121-4e67-88cf-afbfb2c7bfd6 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:33.600869 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f4fe7849-c121-4e67-88cf-afbfb2c7bfd6 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:33.601649 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f4fe7849-c121-4e67-88cf-afbfb2c7bfd6 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:33.603481 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f4fe7849-c121-4e67-88cf-afbfb2c7bfd6 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:33.683018 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-f4fe7849-c121-4e67-88cf-afbfb2c7bfd6 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lazy-loading 'services' on Instance uuid a281ecb1-a100-4005-a1e7-0a6598b9a1b9 {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:38:33.750430 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f4fe7849-c121-4e67-88cf-afbfb2c7bfd6 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/5ca317e7-d8a9-499f-81c0-f0a44c7f6561" status: 202 len: 0 microversion: 2.1 time: 0.162562 Jan 28 20:38:33.751023 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 537/1085] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:38:33 2022] DELETE /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/5ca317e7-d8a9-499f-81c0-f0a44c7f6561 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:38:35.905478 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-56d26776-ac7b-46e1-a3e7-f5e88bdf80e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:35.905996 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-56d26776-ac7b-46e1-a3e7-f5e88bdf80e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:35.912226 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-56d26776-ac7b-46e1-a3e7-f5e88bdf80e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:35.912679 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-56d26776-ac7b-46e1-a3e7-f5e88bdf80e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:35.913508 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-56d26776-ac7b-46e1-a3e7-f5e88bdf80e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:35.913866 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-56d26776-ac7b-46e1-a3e7-f5e88bdf80e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:35.942327 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-56d26776-ac7b-46e1-a3e7-f5e88bdf80e3 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/e13b4d04-05c7-4666-acd6-e9e7e0e6c08f" status: 200 len: 194 microversion: 2.1 time: 0.040498 Jan 28 20:38:35.942891 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 549/1086] 10.222.0.59 () {58 vars in 1412 bytes} [Fri Jan 28 20:38:35 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/e13b4d04-05c7-4666-acd6-e9e7e0e6c08f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:35.953167 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-a5822655-caf2-483f-93a0-13dcdae4709e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:35.953744 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-a5822655-caf2-483f-93a0-13dcdae4709e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:35.959827 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a5822655-caf2-483f-93a0-13dcdae4709e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:35.960276 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a5822655-caf2-483f-93a0-13dcdae4709e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:35.961083 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a5822655-caf2-483f-93a0-13dcdae4709e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:35.961515 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-a5822655-caf2-483f-93a0-13dcdae4709e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:36.036806 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-a5822655-caf2-483f-93a0-13dcdae4709e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lazy-loading 'services' on Instance uuid a281ecb1-a100-4005-a1e7-0a6598b9a1b9 {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:38:36.104069 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-a5822655-caf2-483f-93a0-13dcdae4709e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/e13b4d04-05c7-4666-acd6-e9e7e0e6c08f" status: 202 len: 0 microversion: 2.1 time: 0.155215 Jan 28 20:38:36.104716 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 538/1087] 10.222.0.59 () {58 vars in 1415 bytes} [Fri Jan 28 20:38:35 2022] DELETE /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments/e13b4d04-05c7-4666-acd6-e9e7e0e6c08f => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:38:37.249596 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-bc18a55f-258b-4e38-a2d5-fad3b8f10a08 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:37.250540 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-bc18a55f-258b-4e38-a2d5-fad3b8f10a08 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:37.256724 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bc18a55f-258b-4e38-a2d5-fad3b8f10a08 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:37.257170 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bc18a55f-258b-4e38-a2d5-fad3b8f10a08 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:37.257994 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bc18a55f-258b-4e38-a2d5-fad3b8f10a08 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:37.258432 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-bc18a55f-258b-4e38-a2d5-fad3b8f10a08 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:37.286484 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-bc18a55f-258b-4e38-a2d5-fad3b8f10a08 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040580 Jan 28 20:38:37.287024 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 550/1088] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:38:37 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 20:38:37.387264 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6e79e5ad-8e32-4909-ae1e-ed7e424d6f80 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:37.388298 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6e79e5ad-8e32-4909-ae1e-ed7e424d6f80 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:37.394858 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6e79e5ad-8e32-4909-ae1e-ed7e424d6f80 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:37.395307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6e79e5ad-8e32-4909-ae1e-ed7e424d6f80 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:37.396098 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6e79e5ad-8e32-4909-ae1e-ed7e424d6f80 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:37.396528 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6e79e5ad-8e32-4909-ae1e-ed7e424d6f80 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:37.425805 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6e79e5ad-8e32-4909-ae1e-ed7e424d6f80 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043004 Jan 28 20:38:37.426499 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 539/1089] 10.222.0.59 () {58 vars in 1301 bytes} [Fri Jan 28 20:38:37 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 20:38:37.480422 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-6e514031-a67a-46a9-8961-5c045e89a697 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:37.480907 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-6e514031-a67a-46a9-8961-5c045e89a697 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:37.486652 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6e514031-a67a-46a9-8961-5c045e89a697 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:37.487092 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6e514031-a67a-46a9-8961-5c045e89a697 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:37.487856 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6e514031-a67a-46a9-8961-5c045e89a697 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:37.488279 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-6e514031-a67a-46a9-8961-5c045e89a697 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:37.514659 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-6e514031-a67a-46a9-8961-5c045e89a697 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:38:37.591557 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-6e514031-a67a-46a9-8961-5c045e89a697 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 204 len: 0 microversion: 2.1 time: 0.115171 Jan 28 20:38:37.592160 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 551/1090] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:38:37 2022] DELETE /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:38:37.600481 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ecf8354c-5a6d-4c79-8625-6b459bdcfb8f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:37.601098 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ecf8354c-5a6d-4c79-8625-6b459bdcfb8f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:37.608745 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ecf8354c-5a6d-4c79-8625-6b459bdcfb8f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:37.609201 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ecf8354c-5a6d-4c79-8625-6b459bdcfb8f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:37.610093 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ecf8354c-5a6d-4c79-8625-6b459bdcfb8f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:37.610535 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ecf8354c-5a6d-4c79-8625-6b459bdcfb8f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:37.744975 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ecf8354c-5a6d-4c79-8625-6b459bdcfb8f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:38:37.752210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ecf8354c-5a6d-4c79-8625-6b459bdcfb8f tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1673 microversion: 2.1 time: 0.155581 Jan 28 20:38:37.752784 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 540/1091] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:38:37 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 20:38:38.769780 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-c2c0f640-e4f7-451b-8598-ad58d4221f29 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:38.770561 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-c2c0f640-e4f7-451b-8598-ad58d4221f29 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:38.776782 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c2c0f640-e4f7-451b-8598-ad58d4221f29 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:38.777225 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c2c0f640-e4f7-451b-8598-ad58d4221f29 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:38.778023 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c2c0f640-e4f7-451b-8598-ad58d4221f29 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:38.778458 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-c2c0f640-e4f7-451b-8598-ad58d4221f29 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:38.909727 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-c2c0f640-e4f7-451b-8598-ad58d4221f29 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:38:38.917166 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-c2c0f640-e4f7-451b-8598-ad58d4221f29 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1673 microversion: 2.1 time: 0.151750 Jan 28 20:38:38.917928 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 552/1092] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:38:38 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:38:39.934062 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-e9bbe93e-a04a-449e-a312-74b10e5e80cd tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:39.934675 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-e9bbe93e-a04a-449e-a312-74b10e5e80cd tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:39.940898 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e9bbe93e-a04a-449e-a312-74b10e5e80cd tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:39.941341 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e9bbe93e-a04a-449e-a312-74b10e5e80cd tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:39.942155 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e9bbe93e-a04a-449e-a312-74b10e5e80cd tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:39.942593 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-e9bbe93e-a04a-449e-a312-74b10e5e80cd tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:40.081520 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-e9bbe93e-a04a-449e-a312-74b10e5e80cd tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd078a621ec024fc287d6c8bb8c44679e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0728fb029c4fd3acf933d889ce813d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:38:40.090444 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-e9bbe93e-a04a-449e-a312-74b10e5e80cd tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 200 len: 1673 microversion: 2.1 time: 0.159940 Jan 28 20:38:40.091033 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 541/1093] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:38:39 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:38:40.772873 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-bb027509-4cc3-4b5c-8557-877f185df535 req-141c0d7e-6315-444a-84da-bb9779b03a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a281ecb1-a100-4005-a1e7-0a6598b9a1b9", "name": "network-vif-deleted", "tag": "24f9fcbe-ec8a-4060-9907-5cd74d8b8ffd"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:38:40.774953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:38:40.774953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:38:40.782378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-bb027509-4cc3-4b5c-8557-877f185df535 req-141c0d7e-6315-444a-84da-bb9779b03a0f service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:40.782922 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-bb027509-4cc3-4b5c-8557-877f185df535 req-141c0d7e-6315-444a-84da-bb9779b03a0f service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:40.794730 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-bb027509-4cc3-4b5c-8557-877f185df535 req-141c0d7e-6315-444a-84da-bb9779b03a0f service nova] Creating event network-vif-deleted:24f9fcbe-ec8a-4060-9907-5cd74d8b8ffd for instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 on hv-cinder-82635 Jan 28 20:38:40.800221 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-bb027509-4cc3-4b5c-8557-877f185df535 req-141c0d7e-6315-444a-84da-bb9779b03a0f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184567 Jan 28 20:38:40.801368 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 553/1094] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:41.108280 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-fada5163-67c2-4c4b-a469-4dc0e7d7e34d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:41.108982 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-fada5163-67c2-4c4b-a469-4dc0e7d7e34d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:41.116607 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fada5163-67c2-4c4b-a469-4dc0e7d7e34d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:41.118088 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fada5163-67c2-4c4b-a469-4dc0e7d7e34d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:41.119780 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fada5163-67c2-4c4b-a469-4dc0e7d7e34d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:41.120594 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-fada5163-67c2-4c4b-a469-4dc0e7d7e34d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:41.138161 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-fada5163-67c2-4c4b-a469-4dc0e7d7e34d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] HTTP exception thrown: Instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 could not be found. Jan 28 20:38:41.139254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-fada5163-67c2-4c4b-a469-4dc0e7d7e34d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Returning 404 to user: Instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:38:41.140231 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-fada5163-67c2-4c4b-a469-4dc0e7d7e34d tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 404 len: 111 microversion: 2.1 time: 0.036499 Jan 28 20:38:41.142988 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 542/1095] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:38:41 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:38:41.151678 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-12122dcc-e70e-44a9-8123-f9740155b2be tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '.version_select at 0x7fc779e3e700>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:41.169161 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-12122dcc-e70e-44a9-8123-f9740155b2be tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302566773" status: 202 len: 0 microversion: 2.1 time: 0.021395 Jan 28 20:38:41.169733 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 554/1096] 10.222.0.59 () {58 vars in 1220 bytes} [Fri Jan 28 20:38:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302566773 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 20:38:44.048854 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c8c261cb-25a6-4589-9ef0-b9bea50573e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:44.049344 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-c8c261cb-25a6-4589-9ef0-b9bea50573e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:44.056666 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c8c261cb-25a6-4589-9ef0-b9bea50573e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:44.057113 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c8c261cb-25a6-4589-9ef0-b9bea50573e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:44.057905 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c8c261cb-25a6-4589-9ef0-b9bea50573e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:44.058341 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-c8c261cb-25a6-4589-9ef0-b9bea50573e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:44.072073 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-c8c261cb-25a6-4589-9ef0-b9bea50573e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] HTTP exception thrown: Instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 could not be found. Jan 28 20:38:44.072654 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-c8c261cb-25a6-4589-9ef0-b9bea50573e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Returning 404 to user: Instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:38:44.073470 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-c8c261cb-25a6-4589-9ef0-b9bea50573e4 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 404 len: 111 microversion: 2.1 time: 0.028268 Jan 28 20:38:44.074022 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 543/1097] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:38:44 2022] DELETE /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:38:44.082013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8ff7a50c-1880-415d-8466-e9129a091137 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:44.082748 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8ff7a50c-1880-415d-8466-e9129a091137 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: a281ecb1-a100-4005-a1e7-0a6598b9a1b9] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:44.088697 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ff7a50c-1880-415d-8466-e9129a091137 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:44.089149 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ff7a50c-1880-415d-8466-e9129a091137 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:44.089945 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ff7a50c-1880-415d-8466-e9129a091137 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:44.090386 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8ff7a50c-1880-415d-8466-e9129a091137 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:44.103743 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-8ff7a50c-1880-415d-8466-e9129a091137 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] HTTP exception thrown: Instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 could not be found. Jan 28 20:38:44.104347 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8ff7a50c-1880-415d-8466-e9129a091137 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Returning 404 to user: Instance a281ecb1-a100-4005-a1e7-0a6598b9a1b9 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:38:44.105154 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8ff7a50c-1880-415d-8466-e9129a091137 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9" status: 404 len: 111 microversion: 2.1 time: 0.027285 Jan 28 20:38:44.105669 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 555/1098] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:38:44 2022] GET /compute/v2.1/servers/a281ecb1-a100-4005-a1e7-0a6598b9a1b9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:38:45.230907 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d581c556-a071-4b1c-b757-97905b4aa8a7 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:45.231413 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-d581c556-a071-4b1c-b757-97905b4aa8a7 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:45.237612 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d581c556-a071-4b1c-b757-97905b4aa8a7 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:45.238100 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d581c556-a071-4b1c-b757-97905b4aa8a7 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:45.238871 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d581c556-a071-4b1c-b757-97905b4aa8a7 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:45.239303 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-d581c556-a071-4b1c-b757-97905b4aa8a7 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:45.252918 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-d581c556-a071-4b1c-b757-97905b4aa8a7 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] HTTP exception thrown: Instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed could not be found. Jan 28 20:38:45.253429 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-d581c556-a071-4b1c-b757-97905b4aa8a7 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Returning 404 to user: Instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:38:45.254260 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-d581c556-a071-4b1c-b757-97905b4aa8a7 tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 404 len: 111 microversion: 2.1 time: 0.026967 Jan 28 20:38:45.254782 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 544/1099] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:38:45 2022] DELETE /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:38:45.262864 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7399218d-5a7b-472a-a444-a7cc7949ad4e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:45.263498 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7399218d-5a7b-472a-a444-a7cc7949ad4e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] [instance: 0c701840-780a-4c1e-83e3-d03c2b53b0ed] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:38:45.269974 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7399218d-5a7b-472a-a444-a7cc7949ad4e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:45.270422 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7399218d-5a7b-472a-a444-a7cc7949ad4e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:45.271196 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7399218d-5a7b-472a-a444-a7cc7949ad4e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:38:45.271626 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7399218d-5a7b-472a-a444-a7cc7949ad4e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:38:45.284866 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-7399218d-5a7b-472a-a444-a7cc7949ad4e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] HTTP exception thrown: Instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed could not be found. Jan 28 20:38:45.285435 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7399218d-5a7b-472a-a444-a7cc7949ad4e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] Returning 404 to user: Instance 0c701840-780a-4c1e-83e3-d03c2b53b0ed could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:38:45.286267 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7399218d-5a7b-472a-a444-a7cc7949ad4e tempest-AttachVolumeTestJSON-2133575898 tempest-AttachVolumeTestJSON-2133575898-project] 10.222.0.59 "GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed" status: 404 len: 111 microversion: 2.1 time: 0.027024 Jan 28 20:38:45.286785 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 556/1100] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:38:45 2022] GET /compute/v2.1/servers/0c701840-780a-4c1e-83e3-d03c2b53b0ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:38:51.107734 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-9d878a2a-bd35-47d7-ad43-3cd260a6ff35 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc77946d160>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:51.156204 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-9d878a2a-bd35-47d7-ad43-3cd260a6ff35 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/69dd8bf9-259e-4877-847c-6a6c5ffd41c9" status: 200 len: 349 microversion: 2.1 time: 0.051579 Jan 28 20:38:51.157299 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 545/1101] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:38:51 2022] GET /compute/v2.1/os-volumes/69dd8bf9-259e-4877-847c-6a6c5ffd41c9 => generated 349 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:52.451492 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-d9b223de-dcd5-4613-a070-fe54369a66f5 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc779e56940>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:52.495942 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-d9b223de-dcd5-4613-a070-fe54369a66f5 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/47e949fe-d6ce-4cdb-be5b-827e111dc0bb" status: 200 len: 351 microversion: 2.1 time: 0.047895 Jan 28 20:38:52.496503 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 557/1102] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:38:52 2022] GET /compute/v2.1/os-volumes/47e949fe-d6ce-4cdb-be5b-827e111dc0bb => generated 351 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:53.794133 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ded309ad-7c0a-4fb8-95f6-e72c27deaba9 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc779439280>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:53.837507 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ded309ad-7c0a-4fb8-95f6-e72c27deaba9 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6b7a0dfb-e56c-412c-89e4-6e2faa2ca84e" status: 200 len: 351 microversion: 2.1 time: 0.048161 Jan 28 20:38:53.838250 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 546/1103] 10.222.0.59 () {58 vars in 1244 bytes} [Fri Jan 28 20:38:53 2022] GET /compute/v2.1/os-volumes/6b7a0dfb-e56c-412c-89e4-6e2faa2ca84e => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:53.849077 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-12308d1b-b466-4bdd-9210-82338fe439f8 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc779dc1790>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:53.926302 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-12308d1b-b466-4bdd-9210-82338fe439f8 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.081103 Jan 28 20:38:53.926870 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 558/1104] 10.222.0.59 () {58 vars in 1133 bytes} [Fri Jan 28 20:38:53 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:38:53.938620 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ea38a02f-74b5-4915-983d-60fba7a924b2 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc7796a84c0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:54.016533 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ea38a02f-74b5-4915-983d-60fba7a924b2 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.081359 Jan 28 20:38:54.017093 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 547/1105] 10.222.0.59 () {58 vars in 1148 bytes} [Fri Jan 28 20:38:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:54.029110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-05651897-e256-495a-9345-e845ce7b43d3 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc779571310>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:54.104478 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-05651897-e256-495a-9345-e845ce7b43d3 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.078789 Jan 28 20:38:54.105043 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 559/1106] 10.222.0.59 () {58 vars in 1133 bytes} [Fri Jan 28 20:38:54 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:38:54.115752 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-5f56b869-0956-4f81-b443-bbf3b6fc822d tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc77946de50>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:54.193601 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-5f56b869-0956-4f81-b443-bbf3b6fc822d tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.080943 Jan 28 20:38:54.194084 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 548/1107] 10.222.0.59 () {58 vars in 1166 bytes} [Fri Jan 28 20:38:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:54.205733 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7d022efb-e274-4031-8b52-92212847052b tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc779e568b0>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:54.282046 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7d022efb-e274-4031-8b52-92212847052b tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.079871 Jan 28 20:38:54.282601 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 560/1108] 10.222.0.59 () {58 vars in 1169 bytes} [Fri Jan 28 20:38:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:54.294053 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-3ec26f67-8652-4ee1-92ef-7a3737918c83 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc7796450d0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:54.371849 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-3ec26f67-8652-4ee1-92ef-7a3737918c83 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.081280 Jan 28 20:38:54.372419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 549/1109] 10.222.0.59 () {58 vars in 1154 bytes} [Fri Jan 28 20:38:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:38:54.384530 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-6ea0505d-a469-4912-b6f0-40eb888a564f tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc779ef8430>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:54.465191 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-6ea0505d-a469-4912-b6f0-40eb888a564f tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085271 Jan 28 20:38:54.465754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 561/1110] 10.222.0.59 () {58 vars in 1187 bytes} [Fri Jan 28 20:38:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:38:54.476791 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ef8c50d7-dff4-47a6-8574-25585b080ed2 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] Calling method '.version_select at 0x7fc77969bdc0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:38:54.554734 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ef8c50d7-dff4-47a6-8574-25585b080ed2 tempest-VolumesTestJSON-1062955072 tempest-VolumesTestJSON-1062955072-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.081407 Jan 28 20:38:54.555334 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 550/1111] 10.222.0.59 () {58 vars in 1154 bytes} [Fri Jan 28 20:38:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:39:22.309692 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-947067c5-bbca-4fd8-b0ca-8cc195d67a93 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:22.310294 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-947067c5-bbca-4fd8-b0ca-8cc195d67a93 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:22.316912 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-947067c5-bbca-4fd8-b0ca-8cc195d67a93 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:22.317426 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-947067c5-bbca-4fd8-b0ca-8cc195d67a93 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:22.318333 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-947067c5-bbca-4fd8-b0ca-8cc195d67a93 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:22.318836 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-947067c5-bbca-4fd8-b0ca-8cc195d67a93 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:22.344960 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-947067c5-bbca-4fd8-b0ca-8cc195d67a93 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Going to try to terminate instance {{(pid=116276) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:39:22.435725 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-947067c5-bbca-4fd8-b0ca-8cc195d67a93 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 204 len: 0 microversion: 2.1 time: 0.130933 Jan 28 20:39:22.441040 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 562/1112] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:39:22 2022] DELETE /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:39:22.447420 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-eb340763-3af4-4c23-a28a-ee0b4f042a39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:22.448137 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-eb340763-3af4-4c23-a28a-ee0b4f042a39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:22.454758 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eb340763-3af4-4c23-a28a-ee0b4f042a39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:22.455218 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eb340763-3af4-4c23-a28a-ee0b4f042a39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:22.456080 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eb340763-3af4-4c23-a28a-ee0b4f042a39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:22.456517 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-eb340763-3af4-4c23-a28a-ee0b4f042a39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:22.465199 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-e0d33f57-a7c9-4867-8515-6db71746646f req-e0148c7c-a652-4dd5-b274-f3c2fae9f5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9301756-2919-4996-8f98-7004d11de728", "tag": "38d64510-69e9-4d58-b32a-547abb46e890"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:39:22.466985 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:39:22.466985 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:39:22.474774 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-e0d33f57-a7c9-4867-8515-6db71746646f req-e0148c7c-a652-4dd5-b274-f3c2fae9f5f2 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:22.475229 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-e0d33f57-a7c9-4867-8515-6db71746646f req-e0148c7c-a652-4dd5-b274-f3c2fae9f5f2 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:22.500361 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-e0d33f57-a7c9-4867-8515-6db71746646f req-e0148c7c-a652-4dd5-b274-f3c2fae9f5f2 service nova] Creating event network-changed:38d64510-69e9-4d58-b32a-547abb46e890 for instance e9301756-2919-4996-8f98-7004d11de728 on hv-cinder-82635 Jan 28 20:39:22.517952 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-e0d33f57-a7c9-4867-8515-6db71746646f req-e0148c7c-a652-4dd5-b274-f3c2fae9f5f2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209953 Jan 28 20:39:22.519058 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 551/1113] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:39:22.629266 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-eb340763-3af4-4c23-a28a-ee0b4f042a39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:39:22.637866 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-eb340763-3af4-4c23-a28a-ee0b4f042a39 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1577 microversion: 2.1 time: 0.195231 Jan 28 20:39:22.638871 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 563/1114] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:22 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:39:23.656746 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-23f89bf7-58f2-420e-a6f0-6a1aec16fad9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:23.657350 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-23f89bf7-58f2-420e-a6f0-6a1aec16fad9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:23.663419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-23f89bf7-58f2-420e-a6f0-6a1aec16fad9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:23.663755 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-23f89bf7-58f2-420e-a6f0-6a1aec16fad9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:23.664531 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-23f89bf7-58f2-420e-a6f0-6a1aec16fad9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:23.664965 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-23f89bf7-58f2-420e-a6f0-6a1aec16fad9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:23.799662 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-23f89bf7-58f2-420e-a6f0-6a1aec16fad9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:39:23.807524 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-23f89bf7-58f2-420e-a6f0-6a1aec16fad9 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1458 microversion: 2.1 time: 0.155302 Jan 28 20:39:23.808090 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 552/1115] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:23 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:39:24.825300 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-01cd8e99-6456-4025-963b-7112a84899df tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:24.825977 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-01cd8e99-6456-4025-963b-7112a84899df tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:24.832579 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-01cd8e99-6456-4025-963b-7112a84899df tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:24.833024 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-01cd8e99-6456-4025-963b-7112a84899df tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:24.833896 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-01cd8e99-6456-4025-963b-7112a84899df tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:24.834325 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-01cd8e99-6456-4025-963b-7112a84899df tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:24.982979 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-01cd8e99-6456-4025-963b-7112a84899df tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:39:24.995897 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-01cd8e99-6456-4025-963b-7112a84899df tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 200 len: 1458 microversion: 2.1 time: 0.175317 Jan 28 20:39:24.996652 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 564/1116] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:24 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 1458 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:39:25.110623 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-af84d88b-01bb-4e4a-af1c-360e76c83d9b req-6a484b85-cf6d-4cef-a1a6-8ee2398731b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9301756-2919-4996-8f98-7004d11de728", "name": "network-vif-deleted", "tag": "38d64510-69e9-4d58-b32a-547abb46e890"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:39:25.112183 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:39:25.112183 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:39:25.124323 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-af84d88b-01bb-4e4a-af1c-360e76c83d9b req-6a484b85-cf6d-4cef-a1a6-8ee2398731b3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:25.127182 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-af84d88b-01bb-4e4a-af1c-360e76c83d9b req-6a484b85-cf6d-4cef-a1a6-8ee2398731b3 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:25.145522 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-af84d88b-01bb-4e4a-af1c-360e76c83d9b req-6a484b85-cf6d-4cef-a1a6-8ee2398731b3 service nova] Creating event network-vif-deleted:38d64510-69e9-4d58-b32a-547abb46e890 for instance e9301756-2919-4996-8f98-7004d11de728 on hv-cinder-82635 Jan 28 20:39:25.145522 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-af84d88b-01bb-4e4a-af1c-360e76c83d9b req-6a484b85-cf6d-4cef-a1a6-8ee2398731b3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037778 Jan 28 20:39:25.145522 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 553/1117] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:39:26.012359 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b708cfde-d7c1-4622-9af2-030388c030ac tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:26.012966 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-b708cfde-d7c1-4622-9af2-030388c030ac tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e9301756-2919-4996-8f98-7004d11de728] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:26.020352 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b708cfde-d7c1-4622-9af2-030388c030ac tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:26.020796 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b708cfde-d7c1-4622-9af2-030388c030ac tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:26.021571 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b708cfde-d7c1-4622-9af2-030388c030ac tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:26.022025 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-b708cfde-d7c1-4622-9af2-030388c030ac tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:26.036936 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-b708cfde-d7c1-4622-9af2-030388c030ac tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] HTTP exception thrown: Instance e9301756-2919-4996-8f98-7004d11de728 could not be found. Jan 28 20:39:26.037416 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b708cfde-d7c1-4622-9af2-030388c030ac tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Returning 404 to user: Instance e9301756-2919-4996-8f98-7004d11de728 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:39:26.038269 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b708cfde-d7c1-4622-9af2-030388c030ac tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728" status: 404 len: 111 microversion: 2.1 time: 0.029637 Jan 28 20:39:26.038811 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 565/1118] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:26 2022] GET /compute/v2.1/servers/e9301756-2919-4996-8f98-7004d11de728 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:39:29.293405 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2bbb57db-0590-4e59-951d-d72077d20f7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:29.294262 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2bbb57db-0590-4e59-951d-d72077d20f7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:29.295636 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-6a252696-1c39-4f5e-9431-7668427dfa75 req-6f78400c-f77e-418c-8ef1-0d9e456f5ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e", "tag": "e0e17f6c-bd50-483e-9bf1-112ff384b05a"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:39:29.297341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:39:29.297341 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:39:29.300951 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bbb57db-0590-4e59-951d-d72077d20f7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:29.301411 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bbb57db-0590-4e59-951d-d72077d20f7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:29.302233 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bbb57db-0590-4e59-951d-d72077d20f7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:29.302672 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2bbb57db-0590-4e59-951d-d72077d20f7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:29.305748 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-6a252696-1c39-4f5e-9431-7668427dfa75 req-6f78400c-f77e-418c-8ef1-0d9e456f5ee7 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:29.306288 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-6a252696-1c39-4f5e-9431-7668427dfa75 req-6f78400c-f77e-418c-8ef1-0d9e456f5ee7 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:29.317125 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-6a252696-1c39-4f5e-9431-7668427dfa75 req-6f78400c-f77e-418c-8ef1-0d9e456f5ee7 service nova] Creating event network-changed:e0e17f6c-bd50-483e-9bf1-112ff384b05a for instance 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e on hv-cinder-82635 Jan 28 20:39:29.322316 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-6a252696-1c39-4f5e-9431-7668427dfa75 req-6f78400c-f77e-418c-8ef1-0d9e456f5ee7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030301 Jan 28 20:39:29.323188 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 566/1119] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:39:29.330039 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2bbb57db-0590-4e59-951d-d72077d20f7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:39:29.419077 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2bbb57db-0590-4e59-951d-d72077d20f7d tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "DELETE /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 204 len: 0 microversion: 2.1 time: 0.129899 Jan 28 20:39:29.423159 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 554/1120] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:39:29 2022] DELETE /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:39:29.432189 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ee2beadc-39ee-4d12-83d5-5e68fdde29b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:29.433378 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ee2beadc-39ee-4d12-83d5-5e68fdde29b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:29.441359 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee2beadc-39ee-4d12-83d5-5e68fdde29b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:29.442162 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee2beadc-39ee-4d12-83d5-5e68fdde29b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:29.443219 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee2beadc-39ee-4d12-83d5-5e68fdde29b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:29.443990 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ee2beadc-39ee-4d12-83d5-5e68fdde29b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:29.598741 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-ee2beadc-39ee-4d12-83d5-5e68fdde29b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:39:29.607236 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ee2beadc-39ee-4d12-83d5-5e68fdde29b5 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1577 microversion: 2.1 time: 0.181529 Jan 28 20:39:29.607952 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 567/1121] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:29 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:39:30.624937 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f5f92c83-af0e-4f47-8f54-b0972d7521ae tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:30.625648 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f5f92c83-af0e-4f47-8f54-b0972d7521ae tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:30.632056 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f5f92c83-af0e-4f47-8f54-b0972d7521ae tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:30.632511 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f5f92c83-af0e-4f47-8f54-b0972d7521ae tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:30.633307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f5f92c83-af0e-4f47-8f54-b0972d7521ae tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:30.633911 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f5f92c83-af0e-4f47-8f54-b0972d7521ae tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:30.697717 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f5f92c83-af0e-4f47-8f54-b0972d7521ae tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1f16966e94f0fb861bf124bbc0aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f11f2a3714a9c9a72ab77ea3d288b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:39:30.705271 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f5f92c83-af0e-4f47-8f54-b0972d7521ae tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 200 len: 1392 microversion: 2.1 time: 0.084337 Jan 28 20:39:30.705849 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 555/1122] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:30 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 1392 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:39:31.339201 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-a70f2ba0-6b3b-4916-b0a8-383d66907096 req-66011f4d-133b-4aa6-be7f-3d8159605e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e", "name": "network-vif-deleted", "tag": "e0e17f6c-bd50-483e-9bf1-112ff384b05a"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:39:31.340696 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:39:31.340696 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:39:31.347970 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-a70f2ba0-6b3b-4916-b0a8-383d66907096 req-66011f4d-133b-4aa6-be7f-3d8159605e27 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:31.348386 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-a70f2ba0-6b3b-4916-b0a8-383d66907096 req-66011f4d-133b-4aa6-be7f-3d8159605e27 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:31.359975 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-a70f2ba0-6b3b-4916-b0a8-383d66907096 req-66011f4d-133b-4aa6-be7f-3d8159605e27 service nova] Creating event network-vif-deleted:e0e17f6c-bd50-483e-9bf1-112ff384b05a for instance 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e on hv-cinder-82635 Jan 28 20:39:31.364566 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-a70f2ba0-6b3b-4916-b0a8-383d66907096 req-66011f4d-133b-4aa6-be7f-3d8159605e27 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029488 Jan 28 20:39:31.365150 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 568/1123] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:39:31.722286 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6408b456-fce1-4dbb-9bac-a6914544548a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:31.722886 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-6408b456-fce1-4dbb-9bac-a6914544548a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:31.729743 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6408b456-fce1-4dbb-9bac-a6914544548a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:31.730211 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6408b456-fce1-4dbb-9bac-a6914544548a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:31.730991 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6408b456-fce1-4dbb-9bac-a6914544548a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:31.731409 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-6408b456-fce1-4dbb-9bac-a6914544548a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:31.744059 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-6408b456-fce1-4dbb-9bac-a6914544548a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] HTTP exception thrown: Instance 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e could not be found. Jan 28 20:39:31.744624 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-6408b456-fce1-4dbb-9bac-a6914544548a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Returning 404 to user: Instance 34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:39:31.745423 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-6408b456-fce1-4dbb-9bac-a6914544548a tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e" status: 404 len: 111 microversion: 2.1 time: 0.026818 Jan 28 20:39:31.745952 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 556/1124] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:31 2022] GET /compute/v2.1/servers/34dfb3f9-6ead-41b4-a94d-d39a0eff2e3e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:39:32.192779 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4ae10d4b-0c4f-4e1c-ab07-34a2adc4defb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:32.193620 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-4ae10d4b-0c4f-4e1c-ab07-34a2adc4defb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:32.200704 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ae10d4b-0c4f-4e1c-ab07-34a2adc4defb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:32.201384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ae10d4b-0c4f-4e1c-ab07-34a2adc4defb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:32.202433 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ae10d4b-0c4f-4e1c-ab07-34a2adc4defb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:32.202990 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-4ae10d4b-0c4f-4e1c-ab07-34a2adc4defb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:32.225430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-4ae10d4b-0c4f-4e1c-ab07-34a2adc4defb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] HTTP exception thrown: Instance e3427e95-2a32-4161-ad46-076cf02f603d could not be found. Jan 28 20:39:32.226195 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-4ae10d4b-0c4f-4e1c-ab07-34a2adc4defb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Returning 404 to user: Instance e3427e95-2a32-4161-ad46-076cf02f603d could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:39:32.227654 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-4ae10d4b-0c4f-4e1c-ab07-34a2adc4defb tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 404 len: 111 microversion: 2.1 time: 0.038948 Jan 28 20:39:32.228289 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 569/1125] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:39:32 2022] DELETE /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:39:32.236920 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-13a7f5c1-889d-4e58-be46-95c098fbfe82 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:32.237536 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-13a7f5c1-889d-4e58-be46-95c098fbfe82 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] [instance: e3427e95-2a32-4161-ad46-076cf02f603d] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:32.244138 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-13a7f5c1-889d-4e58-be46-95c098fbfe82 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:32.244524 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-13a7f5c1-889d-4e58-be46-95c098fbfe82 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:32.245349 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-13a7f5c1-889d-4e58-be46-95c098fbfe82 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:32.245790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-13a7f5c1-889d-4e58-be46-95c098fbfe82 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:32.261680 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.wsgi [None req-13a7f5c1-889d-4e58-be46-95c098fbfe82 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] HTTP exception thrown: Instance e3427e95-2a32-4161-ad46-076cf02f603d could not be found. Jan 28 20:39:32.261680 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-13a7f5c1-889d-4e58-be46-95c098fbfe82 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Returning 404 to user: Instance e3427e95-2a32-4161-ad46-076cf02f603d could not be found. {{(pid=116275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:39:32.262069 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-13a7f5c1-889d-4e58-be46-95c098fbfe82 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d" status: 404 len: 111 microversion: 2.1 time: 0.028773 Jan 28 20:39:32.262635 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 557/1126] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:32 2022] GET /compute/v2.1/servers/e3427e95-2a32-4161-ad46-076cf02f603d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:39:32.512597 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:39:32.513174 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: Fri Jan 28 20:39:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:39:33.280352 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:39:33.280866 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: Fri Jan 28 20:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:39:33.561616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-b9411801-1410-4012-908d-fbe7d66e75c2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] Calling method '.version_select at 0x7fc779dc1ca0>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:33.579765 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-b9411801-1410-4012-908d-fbe7d66e75c2 tempest-TestVolumeBootPattern-488323929 tempest-TestVolumeBootPattern-488323929-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1067414585" status: 202 len: 0 microversion: 2.1 time: 0.021764 Jan 28 20:39:33.580371 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 570/1127] 10.222.0.59 () {58 vars in 1262 bytes} [Fri Jan 28 20:39:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1067414585 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:39:38.185776 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:39:38.186249 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: Fri Jan 28 20:39:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:39:56.539506 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-60029467-9572-4212-accd-6fe0ac2c3b04 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:39:56.540186 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-60029467-9572-4212-accd-6fe0ac2c3b04 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:56.546584 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-60029467-9572-4212-accd-6fe0ac2c3b04 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:56.547024 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-60029467-9572-4212-accd-6fe0ac2c3b04 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:56.547786 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-60029467-9572-4212-accd-6fe0ac2c3b04 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:56.548212 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-60029467-9572-4212-accd-6fe0ac2c3b04 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:56.572239 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-60029467-9572-4212-accd-6fe0ac2c3b04 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lazy-loading 'flavor' on Instance uuid 1a83d58a-2acb-4ab1-af31-f8932d53f384 {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:39:56.639321 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-60029467-9572-4212-accd-6fe0ac2c3b04 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "POST /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384/action" status: 202 len: 0 microversion: 2.1 time: 0.103474 Jan 28 20:39:56.639894 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 558/1128] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:39:56 2022] POST /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:39:56.649439 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8eee3a63-5367-4650-9721-621020dafaba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:56.650101 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8eee3a63-5367-4650-9721-621020dafaba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:56.656722 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8eee3a63-5367-4650-9721-621020dafaba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:56.657164 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8eee3a63-5367-4650-9721-621020dafaba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:56.657979 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8eee3a63-5367-4650-9721-621020dafaba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:56.658430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8eee3a63-5367-4650-9721-621020dafaba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:56.795412 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-8eee3a63-5367-4650-9721-621020dafaba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:39:56.802780 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8eee3a63-5367-4650-9721-621020dafaba tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.158304 Jan 28 20:39:56.803365 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 571/1129] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:56 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:39:57.822711 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-88aa27d3-8089-448c-9b81-79a3e08410a9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:57.823419 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-88aa27d3-8089-448c-9b81-79a3e08410a9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:57.829663 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-88aa27d3-8089-448c-9b81-79a3e08410a9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:57.830150 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-88aa27d3-8089-448c-9b81-79a3e08410a9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:57.830936 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-88aa27d3-8089-448c-9b81-79a3e08410a9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:57.831407 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-88aa27d3-8089-448c-9b81-79a3e08410a9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:57.962835 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-88aa27d3-8089-448c-9b81-79a3e08410a9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:39:57.970107 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-88aa27d3-8089-448c-9b81-79a3e08410a9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.152617 Jan 28 20:39:57.970679 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 559/1130] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:57 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:39:58.987481 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-9528a3c3-f59a-4e69-b2df-5ec9a53b37c2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:39:58.988123 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-9528a3c3-f59a-4e69-b2df-5ec9a53b37c2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:39:58.994376 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9528a3c3-f59a-4e69-b2df-5ec9a53b37c2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:58.994816 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9528a3c3-f59a-4e69-b2df-5ec9a53b37c2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:58.995587 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9528a3c3-f59a-4e69-b2df-5ec9a53b37c2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:39:58.996013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-9528a3c3-f59a-4e69-b2df-5ec9a53b37c2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:39:59.128110 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-9528a3c3-f59a-4e69-b2df-5ec9a53b37c2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:39:59.135901 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-9528a3c3-f59a-4e69-b2df-5ec9a53b37c2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.152123 Jan 28 20:39:59.136463 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 572/1131] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:39:58 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:00.154381 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-52faab20-8e0c-494a-b175-fb85d23195f1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:00.154989 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-52faab20-8e0c-494a-b175-fb85d23195f1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:00.161261 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-52faab20-8e0c-494a-b175-fb85d23195f1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:00.161698 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-52faab20-8e0c-494a-b175-fb85d23195f1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:00.162508 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-52faab20-8e0c-494a-b175-fb85d23195f1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:00.162944 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-52faab20-8e0c-494a-b175-fb85d23195f1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:00.303488 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-52faab20-8e0c-494a-b175-fb85d23195f1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:00.310793 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-52faab20-8e0c-494a-b175-fb85d23195f1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.161648 Jan 28 20:40:00.311354 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 560/1132] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:00 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:01.326826 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-5e182df1-0f53-4d5f-a9a5-ae11b25523e6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:01.327364 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-5e182df1-0f53-4d5f-a9a5-ae11b25523e6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:01.333940 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5e182df1-0f53-4d5f-a9a5-ae11b25523e6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:01.334387 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5e182df1-0f53-4d5f-a9a5-ae11b25523e6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:01.335170 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5e182df1-0f53-4d5f-a9a5-ae11b25523e6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:01.335601 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-5e182df1-0f53-4d5f-a9a5-ae11b25523e6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:01.466962 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-5e182df1-0f53-4d5f-a9a5-ae11b25523e6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:01.475005 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-5e182df1-0f53-4d5f-a9a5-ae11b25523e6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.151860 Jan 28 20:40:01.475933 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 573/1133] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:01 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:02.493281 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-611fc1e7-8af4-4831-aadc-75e0e60a9322 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:02.493911 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-611fc1e7-8af4-4831-aadc-75e0e60a9322 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:02.500215 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-611fc1e7-8af4-4831-aadc-75e0e60a9322 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:02.500662 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-611fc1e7-8af4-4831-aadc-75e0e60a9322 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:02.501464 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-611fc1e7-8af4-4831-aadc-75e0e60a9322 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:02.501922 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-611fc1e7-8af4-4831-aadc-75e0e60a9322 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:02.635431 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-611fc1e7-8af4-4831-aadc-75e0e60a9322 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:02.642994 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-611fc1e7-8af4-4831-aadc-75e0e60a9322 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.153705 Jan 28 20:40:02.643569 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 561/1134] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:02 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:03.659454 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-50c423e8-8585-413c-b09a-5fb6d7a0f7d1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:03.660064 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-50c423e8-8585-413c-b09a-5fb6d7a0f7d1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:03.667755 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-50c423e8-8585-413c-b09a-5fb6d7a0f7d1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:03.668203 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-50c423e8-8585-413c-b09a-5fb6d7a0f7d1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:03.668982 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-50c423e8-8585-413c-b09a-5fb6d7a0f7d1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:03.669418 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-50c423e8-8585-413c-b09a-5fb6d7a0f7d1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:03.803452 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-50c423e8-8585-413c-b09a-5fb6d7a0f7d1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:03.810811 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-50c423e8-8585-413c-b09a-5fb6d7a0f7d1 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.155098 Jan 28 20:40:03.811373 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 574/1135] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:03 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:04.828171 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-850b8d4b-7b10-4c3f-824e-d8c98de64746 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:04.828789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-850b8d4b-7b10-4c3f-824e-d8c98de64746 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:04.835497 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-850b8d4b-7b10-4c3f-824e-d8c98de64746 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:04.835937 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-850b8d4b-7b10-4c3f-824e-d8c98de64746 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:04.836706 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-850b8d4b-7b10-4c3f-824e-d8c98de64746 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:04.837139 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-850b8d4b-7b10-4c3f-824e-d8c98de64746 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:04.984246 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-850b8d4b-7b10-4c3f-824e-d8c98de64746 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:04.991677 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-850b8d4b-7b10-4c3f-824e-d8c98de64746 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.167148 Jan 28 20:40:04.992244 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 562/1136] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:04 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:06.008360 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-dcbb1489-6901-4deb-aec0-343b777189c3 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:06.008975 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-dcbb1489-6901-4deb-aec0-343b777189c3 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:06.015305 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dcbb1489-6901-4deb-aec0-343b777189c3 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:06.015754 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dcbb1489-6901-4deb-aec0-343b777189c3 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:06.016536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dcbb1489-6901-4deb-aec0-343b777189c3 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:06.016969 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-dcbb1489-6901-4deb-aec0-343b777189c3 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:06.151896 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-dcbb1489-6901-4deb-aec0-343b777189c3 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:06.159123 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-dcbb1489-6901-4deb-aec0-343b777189c3 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.154423 Jan 28 20:40:06.159690 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 575/1137] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:06 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:07.176359 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-ab43c8ec-1cd9-485e-bf78-0c40dbbc2349 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:07.176970 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-ab43c8ec-1cd9-485e-bf78-0c40dbbc2349 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:07.183966 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab43c8ec-1cd9-485e-bf78-0c40dbbc2349 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:07.184421 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab43c8ec-1cd9-485e-bf78-0c40dbbc2349 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:07.185210 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab43c8ec-1cd9-485e-bf78-0c40dbbc2349 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:07.185652 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-ab43c8ec-1cd9-485e-bf78-0c40dbbc2349 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:07.319596 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-ab43c8ec-1cd9-485e-bf78-0c40dbbc2349 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:07.328720 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-ab43c8ec-1cd9-485e-bf78-0c40dbbc2349 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.155959 Jan 28 20:40:07.329329 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 563/1138] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:07 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:08.345740 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-1628f9a0-6566-4708-ba5d-f30025be556c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:08.346312 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-1628f9a0-6566-4708-ba5d-f30025be556c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:08.352514 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1628f9a0-6566-4708-ba5d-f30025be556c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:08.352954 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1628f9a0-6566-4708-ba5d-f30025be556c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:08.353718 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1628f9a0-6566-4708-ba5d-f30025be556c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:08.354173 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-1628f9a0-6566-4708-ba5d-f30025be556c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:08.489963 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-1628f9a0-6566-4708-ba5d-f30025be556c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:08.497840 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-1628f9a0-6566-4708-ba5d-f30025be556c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.155946 Jan 28 20:40:08.498430 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 576/1139] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:08 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:09.515117 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-dc5e553f-8270-4c96-b9aa-c44772dec799 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:09.515732 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-dc5e553f-8270-4c96-b9aa-c44772dec799 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:09.523254 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc5e553f-8270-4c96-b9aa-c44772dec799 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:09.523709 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc5e553f-8270-4c96-b9aa-c44772dec799 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:09.524499 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc5e553f-8270-4c96-b9aa-c44772dec799 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:09.524940 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-dc5e553f-8270-4c96-b9aa-c44772dec799 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:09.657918 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-dc5e553f-8270-4c96-b9aa-c44772dec799 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:09.665258 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-dc5e553f-8270-4c96-b9aa-c44772dec799 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1570 microversion: 2.1 time: 0.153823 Jan 28 20:40:09.665821 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 564/1140] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:09 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:09.682154 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-ab1566fc-a2bc-44a3-ac2d-81824e3ee214 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:40:09.682699 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-ab1566fc-a2bc-44a3-ac2d-81824e3ee214 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:09.689077 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ab1566fc-a2bc-44a3-ac2d-81824e3ee214 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:09.689516 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ab1566fc-a2bc-44a3-ac2d-81824e3ee214 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:09.690314 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ab1566fc-a2bc-44a3-ac2d-81824e3ee214 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:09.690744 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-ab1566fc-a2bc-44a3-ac2d-81824e3ee214 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:09.779565 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-ab1566fc-a2bc-44a3-ac2d-81824e3ee214 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "POST /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384/action" status: 202 len: 0 microversion: 2.1 time: 0.101532 Jan 28 20:40:09.780426 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 577/1141] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Jan 28 20:40:09 2022] POST /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:40:09.788292 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-236c5a1f-ec3f-4dab-8e16-b1f1c6219f00 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:09.788682 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-236c5a1f-ec3f-4dab-8e16-b1f1c6219f00 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:09.794836 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-236c5a1f-ec3f-4dab-8e16-b1f1c6219f00 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:09.795379 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-236c5a1f-ec3f-4dab-8e16-b1f1c6219f00 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:09.796435 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-236c5a1f-ec3f-4dab-8e16-b1f1c6219f00 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:09.796887 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-236c5a1f-ec3f-4dab-8e16-b1f1c6219f00 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:09.942628 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-236c5a1f-ec3f-4dab-8e16-b1f1c6219f00 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:09.950565 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-236c5a1f-ec3f-4dab-8e16-b1f1c6219f00 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1518 microversion: 2.1 time: 0.166284 Jan 28 20:40:09.951135 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 565/1142] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:09 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:10.968585 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f8d0b269-aa94-426e-9c47-b08bf1d7aa18 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:10.969766 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f8d0b269-aa94-426e-9c47-b08bf1d7aa18 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:10.975869 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f8d0b269-aa94-426e-9c47-b08bf1d7aa18 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:10.976314 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f8d0b269-aa94-426e-9c47-b08bf1d7aa18 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:10.977103 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f8d0b269-aa94-426e-9c47-b08bf1d7aa18 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:10.977536 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f8d0b269-aa94-426e-9c47-b08bf1d7aa18 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:11.112948 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f8d0b269-aa94-426e-9c47-b08bf1d7aa18 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:11.120340 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f8d0b269-aa94-426e-9c47-b08bf1d7aa18 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1520 microversion: 2.1 time: 0.155478 Jan 28 20:40:11.120908 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 578/1143] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:10 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:11.671355 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [req-21287927-ef22-4939-8022-9f8200ad6e1a req-0bdf7452-9a66-4bf2-bfd2-f501f1737615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a83d58a-2acb-4ab1-af31-f8932d53f384", "name": "network-vif-unplugged", "status": "completed", "tag": "29aa8a32-9948-4e90-af5d-9ac2ff31e4f0"}]} {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:40:11.672940 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:40:11.672940 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: warnings.warn(msg) Jan 28 20:40:11.679765 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-21287927-ef22-4939-8022-9f8200ad6e1a req-0bdf7452-9a66-4bf2-bfd2-f501f1737615 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:11.680214 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [req-21287927-ef22-4939-8022-9f8200ad6e1a req-0bdf7452-9a66-4bf2-bfd2-f501f1737615 service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:11.691503 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.compute.server_external_events [req-21287927-ef22-4939-8022-9f8200ad6e1a req-0bdf7452-9a66-4bf2-bfd2-f501f1737615 service nova] Creating event network-vif-unplugged:29aa8a32-9948-4e90-af5d-9ac2ff31e4f0 for instance 1a83d58a-2acb-4ab1-af31-f8932d53f384 on hv-cinder-82635 Jan 28 20:40:11.696436 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [req-21287927-ef22-4939-8022-9f8200ad6e1a req-0bdf7452-9a66-4bf2-bfd2-f501f1737615 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157176 Jan 28 20:40:11.697257 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 566/1144] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:40:12.138722 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-64204743-f45e-4940-9d9f-91009068eea2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:12.139324 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-64204743-f45e-4940-9d9f-91009068eea2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:12.146043 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-64204743-f45e-4940-9d9f-91009068eea2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:12.146491 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-64204743-f45e-4940-9d9f-91009068eea2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:12.147273 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-64204743-f45e-4940-9d9f-91009068eea2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:12.147706 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-64204743-f45e-4940-9d9f-91009068eea2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:12.282820 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-64204743-f45e-4940-9d9f-91009068eea2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:12.290237 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-64204743-f45e-4940-9d9f-91009068eea2 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1576 microversion: 2.1 time: 0.155029 Jan 28 20:40:12.290726 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 579/1145] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:12 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:13.308307 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-2c82016e-d170-4e58-b24d-2c115c86ddfe tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:13.309001 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-2c82016e-d170-4e58-b24d-2c115c86ddfe tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:13.315091 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2c82016e-d170-4e58-b24d-2c115c86ddfe tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:13.315536 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2c82016e-d170-4e58-b24d-2c115c86ddfe tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:13.316311 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2c82016e-d170-4e58-b24d-2c115c86ddfe tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:13.316746 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-2c82016e-d170-4e58-b24d-2c115c86ddfe tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:13.448890 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-2c82016e-d170-4e58-b24d-2c115c86ddfe tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:13.456225 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-2c82016e-d170-4e58-b24d-2c115c86ddfe tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1576 microversion: 2.1 time: 0.152983 Jan 28 20:40:13.456789 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 567/1146] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:13 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:14.472919 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7616dcc4-23d4-4993-90ef-f54718a68c28 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:14.473568 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7616dcc4-23d4-4993-90ef-f54718a68c28 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:14.480299 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7616dcc4-23d4-4993-90ef-f54718a68c28 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:14.480736 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7616dcc4-23d4-4993-90ef-f54718a68c28 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:14.481500 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7616dcc4-23d4-4993-90ef-f54718a68c28 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:14.481953 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7616dcc4-23d4-4993-90ef-f54718a68c28 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:14.612144 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7616dcc4-23d4-4993-90ef-f54718a68c28 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:14.619977 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7616dcc4-23d4-4993-90ef-f54718a68c28 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1576 microversion: 2.1 time: 0.150700 Jan 28 20:40:14.620535 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 580/1147] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:14 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:15.637028 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-1a02821d-a166-44c6-b651-af5e7a93890c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:15.637657 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-1a02821d-a166-44c6-b651-af5e7a93890c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:15.644117 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1a02821d-a166-44c6-b651-af5e7a93890c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:15.644557 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1a02821d-a166-44c6-b651-af5e7a93890c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:15.645326 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1a02821d-a166-44c6-b651-af5e7a93890c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:15.645757 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-1a02821d-a166-44c6-b651-af5e7a93890c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:15.784080 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-1a02821d-a166-44c6-b651-af5e7a93890c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:15.791312 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-1a02821d-a166-44c6-b651-af5e7a93890c tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1576 microversion: 2.1 time: 0.158493 Jan 28 20:40:15.791887 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 568/1148] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:15 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:16.808702 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-0e0d9f8e-25ed-4f05-b90c-f39083542e79 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:16.809306 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-0e0d9f8e-25ed-4f05-b90c-f39083542e79 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:16.815616 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e0d9f8e-25ed-4f05-b90c-f39083542e79 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:16.816065 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e0d9f8e-25ed-4f05-b90c-f39083542e79 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:16.816834 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e0d9f8e-25ed-4f05-b90c-f39083542e79 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:16.817268 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-0e0d9f8e-25ed-4f05-b90c-f39083542e79 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:16.948218 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-0e0d9f8e-25ed-4f05-b90c-f39083542e79 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:16.955452 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-0e0d9f8e-25ed-4f05-b90c-f39083542e79 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1576 microversion: 2.1 time: 0.151017 Jan 28 20:40:16.956013 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 581/1149] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:16 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:17.972067 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-50336903-cb53-4a41-8202-14c200e5b3f9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:17.972664 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-50336903-cb53-4a41-8202-14c200e5b3f9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:17.979619 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50336903-cb53-4a41-8202-14c200e5b3f9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:17.980061 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50336903-cb53-4a41-8202-14c200e5b3f9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:17.980860 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50336903-cb53-4a41-8202-14c200e5b3f9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:17.981289 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-50336903-cb53-4a41-8202-14c200e5b3f9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:18.125125 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-50336903-cb53-4a41-8202-14c200e5b3f9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:18.132394 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-50336903-cb53-4a41-8202-14c200e5b3f9 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1576 microversion: 2.1 time: 0.164001 Jan 28 20:40:18.132990 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 569/1150] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:17 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:19.148760 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-7f4a55a4-c164-4851-b380-32b173e53ba6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:19.149441 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-7f4a55a4-c164-4851-b380-32b173e53ba6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:19.155719 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7f4a55a4-c164-4851-b380-32b173e53ba6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:19.156168 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7f4a55a4-c164-4851-b380-32b173e53ba6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:19.156949 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7f4a55a4-c164-4851-b380-32b173e53ba6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:19.157380 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-7f4a55a4-c164-4851-b380-32b173e53ba6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:19.286750 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-7f4a55a4-c164-4851-b380-32b173e53ba6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:19.294549 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-7f4a55a4-c164-4851-b380-32b173e53ba6 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1576 microversion: 2.1 time: 0.149509 Jan 28 20:40:19.295124 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 582/1151] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:19 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:20.312447 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-f322ec3b-0a4e-4999-aad7-33dbc2425fb4 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:40:20.313103 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-f322ec3b-0a4e-4999-aad7-33dbc2425fb4 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:40:20.319340 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f322ec3b-0a4e-4999-aad7-33dbc2425fb4 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:20.319790 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f322ec3b-0a4e-4999-aad7-33dbc2425fb4 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:20.320583 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f322ec3b-0a4e-4999-aad7-33dbc2425fb4 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:20.321028 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-f322ec3b-0a4e-4999-aad7-33dbc2425fb4 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:20.466155 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-f322ec3b-0a4e-4999-aad7-33dbc2425fb4 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:40:20.473478 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-f322ec3b-0a4e-4999-aad7-33dbc2425fb4 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1563 microversion: 2.1 time: 0.165446 Jan 28 20:40:20.474077 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 570/1152] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:40:20 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:40:23.636072 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-fe435fa5-0c46-4e1e-9eab-41add05f2758 req-3423d3c0-cc02-4754-b622-bee2568827fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a83d58a-2acb-4ab1-af31-f8932d53f384", "name": "network-vif-plugged", "status": "completed", "tag": "29aa8a32-9948-4e90-af5d-9ac2ff31e4f0"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:40:23.637592 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:40:23.637592 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:40:23.645993 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-fe435fa5-0c46-4e1e-9eab-41add05f2758 req-3423d3c0-cc02-4754-b622-bee2568827fa service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:40:23.646438 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-fe435fa5-0c46-4e1e-9eab-41add05f2758 req-3423d3c0-cc02-4754-b622-bee2568827fa service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:40:23.657294 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-fe435fa5-0c46-4e1e-9eab-41add05f2758 req-3423d3c0-cc02-4754-b622-bee2568827fa service nova] Creating event network-vif-plugged:29aa8a32-9948-4e90-af5d-9ac2ff31e4f0 for instance 1a83d58a-2acb-4ab1-af31-f8932d53f384 on hv-cinder-82635 Jan 28 20:40:23.662371 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-fe435fa5-0c46-4e1e-9eab-41add05f2758 req-3423d3c0-cc02-4754-b622-bee2568827fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029921 Jan 28 20:40:23.662950 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 583/1153] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:42:05.083895 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4afc9565-eb1e-4ff4-b6a9-f918c3435cec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:42:05.084671 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4afc9565-eb1e-4ff4-b6a9-f918c3435cec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:42:05.087012 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-db70f00d-aaa2-48ca-becd-cb7217611e48 req-4e5af522-80e8-483d-a5f4-4783a063034b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a83d58a-2acb-4ab1-af31-f8932d53f384", "tag": "29aa8a32-9948-4e90-af5d-9ac2ff31e4f0"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:42:05.088507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:42:05.088507 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:42:05.090799 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4afc9565-eb1e-4ff4-b6a9-f918c3435cec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:05.091256 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4afc9565-eb1e-4ff4-b6a9-f918c3435cec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:05.092050 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4afc9565-eb1e-4ff4-b6a9-f918c3435cec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:05.092487 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4afc9565-eb1e-4ff4-b6a9-f918c3435cec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:05.095475 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-db70f00d-aaa2-48ca-becd-cb7217611e48 req-4e5af522-80e8-483d-a5f4-4783a063034b service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:05.095921 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-db70f00d-aaa2-48ca-becd-cb7217611e48 req-4e5af522-80e8-483d-a5f4-4783a063034b service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:05.106662 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-db70f00d-aaa2-48ca-becd-cb7217611e48 req-4e5af522-80e8-483d-a5f4-4783a063034b service nova] Creating event network-changed:29aa8a32-9948-4e90-af5d-9ac2ff31e4f0 for instance 1a83d58a-2acb-4ab1-af31-f8932d53f384 on hv-cinder-82635 Jan 28 20:42:05.111713 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-db70f00d-aaa2-48ca-becd-cb7217611e48 req-4e5af522-80e8-483d-a5f4-4783a063034b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030619 Jan 28 20:42:05.112304 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 584/1154] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 20:42:05.121333 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4afc9565-eb1e-4ff4-b6a9-f918c3435cec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Going to try to terminate instance {{(pid=116275) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 20:42:05.204454 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4afc9565-eb1e-4ff4-b6a9-f918c3435cec tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 204 len: 0 microversion: 2.1 time: 0.125666 Jan 28 20:42:05.205466 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 571/1155] 10.222.0.59 () {58 vars in 1238 bytes} [Fri Jan 28 20:42:05 2022] DELETE /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 20:42:05.217010 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-f939c663-fd82-4559-8194-33574dfafd68 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:42:05.218035 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-f939c663-fd82-4559-8194-33574dfafd68 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:42:05.224861 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f939c663-fd82-4559-8194-33574dfafd68 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:05.225609 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f939c663-fd82-4559-8194-33574dfafd68 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:05.226428 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f939c663-fd82-4559-8194-33574dfafd68 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:05.226857 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-f939c663-fd82-4559-8194-33574dfafd68 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:05.447001 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.policy [None req-f939c663-fd82-4559-8194-33574dfafd68 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116276) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:42:05.454277 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-f939c663-fd82-4559-8194-33574dfafd68 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1569 microversion: 2.1 time: 0.242420 Jan 28 20:42:05.454849 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 585/1156] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:42:05 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:42:06.472844 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-4384154d-af04-4b73-9b6d-f31454c6a27d tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:42:06.473659 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-4384154d-af04-4b73-9b6d-f31454c6a27d tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:42:06.480160 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4384154d-af04-4b73-9b6d-f31454c6a27d tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:06.480611 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4384154d-af04-4b73-9b6d-f31454c6a27d tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:06.481395 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4384154d-af04-4b73-9b6d-f31454c6a27d tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:06.481830 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-4384154d-af04-4b73-9b6d-f31454c6a27d tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:06.677312 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-4384154d-af04-4b73-9b6d-f31454c6a27d tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:42:06.685104 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-4384154d-af04-4b73-9b6d-f31454c6a27d tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1450 microversion: 2.1 time: 0.216290 Jan 28 20:42:06.685684 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 572/1157] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:42:06 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1450 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:42:07.357898 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [req-083dcf4c-78d6-4a7c-a2ef-dfe158c6a866 req-5f76d338-584f-4541-9e1b-6813c9f19afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a83d58a-2acb-4ab1-af31-f8932d53f384", "name": "network-vif-deleted", "tag": "29aa8a32-9948-4e90-af5d-9ac2ff31e4f0"}]} {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 20:42:07.359402 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 20:42:07.359402 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: warnings.warn(msg) Jan 28 20:42:07.367475 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-083dcf4c-78d6-4a7c-a2ef-dfe158c6a866 req-5f76d338-584f-4541-9e1b-6813c9f19afc service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:07.367917 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [req-083dcf4c-78d6-4a7c-a2ef-dfe158c6a866 req-5f76d338-584f-4541-9e1b-6813c9f19afc service nova] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:07.378816 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.compute.server_external_events [req-083dcf4c-78d6-4a7c-a2ef-dfe158c6a866 req-5f76d338-584f-4541-9e1b-6813c9f19afc service nova] Creating event network-vif-deleted:29aa8a32-9948-4e90-af5d-9ac2ff31e4f0 for instance 1a83d58a-2acb-4ab1-af31-f8932d53f384 on hv-cinder-82635 Jan 28 20:42:07.383551 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [req-083dcf4c-78d6-4a7c-a2ef-dfe158c6a866 req-5f76d338-584f-4541-9e1b-6813c9f19afc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029249 Jan 28 20:42:07.384137 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 586/1158] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Jan 28 20:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 20:42:07.702567 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:42:07.703247 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.compute.api [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116275) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:42:07.711366 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:07.711974 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:07.712784 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:07.713230 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:07.752150 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:07.752868 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG oslo_concurrency.lockutils [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:07.753475 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.objects.instance [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lazy-loading 'fault' on Instance uuid 1a83d58a-2acb-4ab1-af31-f8932d53f384 {{(pid=116275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 20:42:07.798351 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.policy [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbac7ec87a40dab1aad77948afcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0bc0d163664eefa8c2c16ca7a80896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116275) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 20:42:07.806173 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-68c2f0ba-5a9b-4a68-9d0d-7a955a0cf172 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 200 len: 1223 microversion: 2.1 time: 0.107883 Jan 28 20:42:07.806730 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 573/1159] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:42:07 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 20:42:08.824122 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8461c9bd-e7c5-4fe2-a178-45bf0b374d7e tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '>' {{(pid=116276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:42:08.824821 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.compute.api [None req-8461c9bd-e7c5-4fe2-a178-45bf0b374d7e tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] [instance: 1a83d58a-2acb-4ab1-af31-f8932d53f384] Fetching instance by UUID {{(pid=116276) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 20:42:08.830951 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8461c9bd-e7c5-4fe2-a178-45bf0b374d7e tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:08.831394 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8461c9bd-e7c5-4fe2-a178-45bf0b374d7e tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:08.832167 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8461c9bd-e7c5-4fe2-a178-45bf0b374d7e tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 20:42:08.832646 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG oslo_concurrency.lockutils [None req-8461c9bd-e7c5-4fe2-a178-45bf0b374d7e tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Lock "87872759-4d17-418e-b91c-df15c67a4efe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 20:42:08.845265 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.wsgi [None req-8461c9bd-e7c5-4fe2-a178-45bf0b374d7e tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] HTTP exception thrown: Instance 1a83d58a-2acb-4ab1-af31-f8932d53f384 could not be found. Jan 28 20:42:08.845837 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: DEBUG nova.api.openstack.wsgi [None req-8461c9bd-e7c5-4fe2-a178-45bf0b374d7e tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Returning 404 to user: Instance 1a83d58a-2acb-4ab1-af31-f8932d53f384 could not be found. {{(pid=116276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 20:42:08.846673 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO nova.api.openstack.requestlog [None req-8461c9bd-e7c5-4fe2-a178-45bf0b374d7e tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384" status: 404 len: 111 microversion: 2.1 time: 0.027056 Jan 28 20:42:08.847190 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: [pid: 116276|app: 0|req: 587/1160] 10.222.0.59 () {58 vars in 1235 bytes} [Fri Jan 28 20:42:08 2022] GET /compute/v2.1/servers/1a83d58a-2acb-4ab1-af31-f8932d53f384 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 20:42:09.003992 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: DEBUG nova.api.openstack.wsgi [None req-cb9438ac-4959-4097-8a86-0e678cb17105 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] Calling method '.version_select at 0x7fc779643ca0>' {{(pid=116275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 20:42:09.031327 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO nova.api.openstack.requestlog [None req-cb9438ac-4959-4097-8a86-0e678cb17105 tempest-TestShelveInstance-1008034124 tempest-TestShelveInstance-1008034124-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-224574802" status: 202 len: 0 microversion: 2.1 time: 0.031043 Jan 28 20:42:09.037665 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: [pid: 116275|app: 0|req: 574/1161] 10.222.0.59 () {58 vars in 1250 bytes} [Fri Jan 28 20:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-224574802 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 20:42:31.449213 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:42:31.449808 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: Fri Jan 28 20:42:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:42:52.522584 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:42:52.523220 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: Fri Jan 28 20:42:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:42:53.288924 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:42:53.289485 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: Fri Jan 28 20:42:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:44:38.195846 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:44:38.196692 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: Fri Jan 28 20:44:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:44:55.797158 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:44:55.798442 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: Fri Jan 28 20:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:44:55.951258 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:44:55.951721 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: Fri Jan 28 20:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:45:51.457220 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:45:51.457811 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: Fri Jan 28 20:45:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:46:12.531737 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:46:12.532384 dv-cinder-826350-4-iscsi devstack@n-api.service[116276]: Fri Jan 28 20:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 20:46:13.297837 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 20:46:13.298370 dv-cinder-826350-4-iscsi devstack@n-api.service[116275]: Fri Jan 28 20:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!